-- Logs begin at Mon 2022-10-24 08:03:08 UTC, end at Mon 2022-10-24 09:02:05 UTC. -- Oct 24 08:34:00.075314 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 24 08:34:00.084150 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 08:34:00 2022] *** Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: nodename: dv-osbrick-master-4-iscsi Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: machine: x86_64 Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: clock source: unix Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: pcre jit disabled Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: detected number of CPU cores: 4 Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: current working directory: / Oct 24 08:34:00.086229 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: detected binary path: /usr/bin/uwsgi-core Oct 24 08:34:00.086794 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: your processes number limit is 47680 Oct 24 08:34:00.086794 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: your memory page size is 4096 bytes Oct 24 08:34:00.086794 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: detected max file descriptor number: 2048 Oct 24 08:34:00.086794 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: lock engine: pthread robust mutexes Oct 24 08:34:00.086794 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: thunder lock: enabled Oct 24 08:34:00.086794 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 24 08:34:00.086794 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 08:34:00.126784 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: Python main interpreter initialized at 0x55577e8589c0 Oct 24 08:34:00.126784 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: python threads support enabled Oct 24 08:34:00.126784 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: your server socket listen backlog is limited to 100 connections Oct 24 08:34:00.126784 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: your mercy for graceful operations on workers is 90 seconds Oct 24 08:34:00.127132 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 08:34:00.127205 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: *** Operational MODE: preforking *** Oct 24 08:34:00.127468 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: *** uWSGI is running in multiple interpreter mode *** Oct 24 08:34:00.127468 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: spawned uWSGI master process (pid: 88323) Oct 24 08:34:00.127665 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 24 08:34:00.128206 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: spawned uWSGI worker 1 (pid: 88334, cores: 1) Oct 24 08:34:00.128526 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: spawned uWSGI worker 2 (pid: 88335, cores: 1) Oct 24 08:34:00.129588 dv-osbrick-master-4-iscsi devstack@keystone.service[88323]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 08:34:04.468034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:34:04.468034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: from cryptography.utils import int_from_bytes Oct 24 08:34:04.468834 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:34:04.468834 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: from cryptography.utils import int_from_bytes Oct 24 08:34:04.468947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:34:04.468947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: from cryptography.utils import int_from_bytes Oct 24 08:34:04.469346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:34:04.469346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: from cryptography.utils import int_from_bytes Oct 24 08:34:04.519251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:34:04.519454 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:34:04.519558 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:34:04.519645 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] command line args: [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:34:04.519721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:34:04.519840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] command line args: [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:34:04.519926 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:34:04.520014 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ================================================================================ {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:34:04.520116 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:34:04.520286 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] admin_token = **** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.520378 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ================================================================================ {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:34:04.520506 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] config_dir = [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.520587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] admin_token = **** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.520694 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.520777 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] config_dir = [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.520875 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] config_source = [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.520956 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.521057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] debug = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.521140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] config_source = [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.521257 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.522518 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] debug = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.522518 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.522673 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.522738 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.522794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.522854 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.522914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.522980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] list_limit = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] list_limit = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523269 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] log_config_append = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523330 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] log_config_append = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523387 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523442 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523496 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] log_dir = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523556 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] log_dir = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523611 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] log_file = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523675 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] log_file = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523847 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523907 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.523962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524023 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524210 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524290 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524415 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524519 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524624 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524767 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.524851 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525121 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525235 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525317 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525487 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525727 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525812 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.525960 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.526082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.526194 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.526305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.526439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.526586 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.526702 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.526963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.527148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] publish_errors = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.527274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.527398 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] publish_errors = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.527504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.527649 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.527846 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.527846 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528263 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528516 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528740 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] standard_threads = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528856 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] standard_threads = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.528979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.529092 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.529203 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.529319 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.529431 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.529597 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.529819 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] use_journal = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.529935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] use_journal = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530074 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] use_json = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] use_json = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] use_stderr = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530420 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] use_stderr = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] use_syslog = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530653 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] use_syslog = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530762 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530873 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:04.530982 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.531092 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.531213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.531325 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.531436 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.531545 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.531663 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.531779 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.531898 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532707 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532821 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.532937 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.533054 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.533165 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.533284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.533395 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.533549 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.533669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.533781 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.533891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534010 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534700 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.534923 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.535037 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.535155 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.535266 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.535458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.535579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.535697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.535809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.535925 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536383 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536493 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536604 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536850 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.536963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.537086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.537204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.537316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.537455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.537580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.537693 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.537811 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.537929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538041 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538160 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538272 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538383 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538714 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538833 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.538947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539064 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539411 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539531 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539652 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539765 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.539987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.540097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.540255 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.540368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.540485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.540596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.540713 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.540825 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541131 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541354 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541605 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541728 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.541927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542122 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542214 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542408 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542686 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542779 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542879 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.542993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.543120 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.543728 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.543842 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.543952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544252 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.544806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.545019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.545019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.545235 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.545349 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.545583 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.545692 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.545815 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.545815 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546035 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546035 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546271 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546375 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546707 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546814 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546936 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.546936 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.547137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.547137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.547346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.547457 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.547567 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.547679 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.547796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.547898 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548009 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548238 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548353 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548471 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548819 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.548941 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.549054 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.549172 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.549284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.549403 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.549542 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.549673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.549794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.549908 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550020 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550281 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550519 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550632 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.550966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551199 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551311 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551422 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551536 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551647 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.551997 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.552109 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.552221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.552337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.552524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.552646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.552759 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.552877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.552990 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.553117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.553239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.553360 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.553512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.553637 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.553751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.553869 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.553982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.554105 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.554219 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.554331 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.554443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.554555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.554669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.554788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.554901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555244 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555814 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555931 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.555931 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] auth.external = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.556170 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.556292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.556414 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.556539 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.556655 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] auth.external = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.556768 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.556886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.556999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] auth.password = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.557120 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.557235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] auth.token = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.557355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.557502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.557618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] auth.password = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.557731 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.557857 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] auth.token = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.557972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.558085 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.558202 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.558316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.558429 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.558550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.558664 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.558777 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.558924 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.559568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.559667 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] credential.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.559769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.559838 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.559897 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.559954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] credential.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560074 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560208 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560266 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560382 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560564 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560680 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560793 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560849 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.560914 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.561119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.561245 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.561361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.561522 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.561638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.561765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.561913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562033 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562615 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] federation.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562729 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562842 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.562956 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.563071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.563192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] federation.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.563306 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.563420 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.563533 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.563646 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.563770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.563892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564007 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564348 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564469 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564583 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564835 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.564949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.565063 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.565185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.565299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.565413 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.565558 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.565671 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.565784 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.565977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.566094 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.566215 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.566329 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.566442 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.566556 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.566677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.566791 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.566904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567592 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567705 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567817 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.567937 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.568060 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.568174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.568288 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.568401 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.568514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.568627 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.568748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.568862 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.569043 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.569160 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.569275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.569389 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.569537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.569654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.569768 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.569880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570114 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570403 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570747 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570860 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.570981 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.571095 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.571209 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.571321 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.571435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.571548 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.571668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.571788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.571902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572128 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572240 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572589 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572701 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572813 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.572926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.573046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.573161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.573274 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.573386 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.573552 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.573666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.573790 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.573934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.574051 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.574170 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.574283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.574404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.574559 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.574711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.574711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.574916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575232 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575345 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575457 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.575919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576031 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576031 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576688 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576800 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576912 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.576912 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.577135 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.577249 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.577361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.577487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.577601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.577715 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.577840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.577840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578053 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578053 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578264 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.578935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.579153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.579267 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.579381 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.579493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.579606 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.579718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.579840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.579954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.580066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.580179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.580291 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.580409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.580565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.580680 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.580793 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.580906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581507 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581849 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.581975 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.582090 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.582203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.582315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.582428 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.582541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.582662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.582776 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.582889 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583115 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583349 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583576 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583576 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.583786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584120 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584345 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584690 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.584917 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585029 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585255 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585730 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585842 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.585955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] resource.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586195 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586308 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586533 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] resource.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586645 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.586993 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.587106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.587220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.587332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.587453 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.587566 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.587680 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.587792 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.587905 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.588018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.588208 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.588331 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] role.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.588445 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.588557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] role.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.588670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.588791 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.588906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] role.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] role.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589246 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589360 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589535 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589652 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589879 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.589992 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.590106 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.590240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.590428 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.590661 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.590850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.590975 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.591090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.591213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.591330 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.591444 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.591559 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.591559 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.591773 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.591895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592010 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592124 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592353 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592353 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592790 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.592904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593018 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593131 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593840 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.593966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.594082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.594196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.594310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.594423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.594546 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.594661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.594774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.594888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595114 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595349 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595577 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595690 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595804 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.595925 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596040 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596266 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596494 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596617 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596845 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] token.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.596959 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.597072 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.597186 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] token.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.597311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.597426 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.597600 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.597716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.597829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.597943 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598183 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598297 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598410 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598522 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.598988 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599102 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599215 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599215 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599558 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599671 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599785 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.599898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.600117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.600235 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.600349 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.600349 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.600579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.600579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.600839 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.600962 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.601077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.connection = **** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.601198 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.601312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.601425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.connection = **** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.601557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.601557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.601768 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.601894 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602009 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602468 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602590 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602705 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602817 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.602932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603044 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603157 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603392 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603841 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.603962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604077 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604301 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604644 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604758 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.604984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.605096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.605209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.605329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:34:04.605460 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.605460 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:04.605460 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:34:04.635895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.636118 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.636208 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.636286 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.636360 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.644867 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.644977 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.674816 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.675046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.675426 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.675665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.728252 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.728512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.778482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.778702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.779384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.779624 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.938365 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.938561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.938643 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.938707 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.938791 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.938864 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.939003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.939084 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.939222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.939308 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.939433 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.939513 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.962729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.962960 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.963183 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.963280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.963404 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.963486 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.963623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.963704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.963840 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.963922 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.964056 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.964144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.964269 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.964487 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.975941 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.976434 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990182 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990263 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990337 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990439 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990531 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990659 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990739 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.990956 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.991085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.991173 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.991295 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:04.991377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:05.008382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.008592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 08:34:05.008685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.008896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 08:34:05.008976 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.009123 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 08:34:05.009238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.009401 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.009514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 08:34:05.009708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.009789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.009982 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.010235 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.010503 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.010584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.010767 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.019980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.020158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.020268 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.020441 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.020544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.020714 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.020833 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.020996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.028457 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.028554 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.031397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.031491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.031687 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.031781 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.031972 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.032054 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.032258 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.032338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.032539 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.032629 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.032803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.032884 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.033075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.033155 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.033351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.033432 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.033764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.033845 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.034043 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.034133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.034314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.034394 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.057474 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.057609 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.058945 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.059053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.059719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.059815 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.065902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.066188 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.066425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.066510 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.066719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.067009 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.072970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.073260 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.073459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.073770 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.078060 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.078354 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.078641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.078737 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.078929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.079010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.079210 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.079289 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.079486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.079580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.079768 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.079847 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.080048 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.080134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.080329 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.080616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.096251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.096532 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.096933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.097218 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.100378 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.101096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.103622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.103933 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.104360 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.104662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.108189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.109218 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.111326 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.112394 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.114835 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.115137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.115437 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.115739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.115911 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.116032 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.116215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.116315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.116504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.116794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.117093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.117378 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.132157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.132450 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.132713 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.132976 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.133362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.133685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.133960 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.134225 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.140576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.141713 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.142145 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.143251 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.143673 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.143970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.144795 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.145089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.146674 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.146963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.147352 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.147639 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.147907 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.147989 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.148249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.148644 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.148933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.149221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.159801 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.160087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.160465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.160757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.161050 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.161334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.161638 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.162068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.162754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.163044 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.163341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.163626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.163927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.177066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.179456 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.180036 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.182463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.182999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.184747 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.185552 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.186508 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.186808 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.187005 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.187093 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.188635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.188933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.189221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.193453 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.194930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.195613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.197083 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.197957 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.198249 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.198536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.198816 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.200789 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.201081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.201369 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.201674 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.207231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.207527 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.207822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.209502 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.209803 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.210091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.216291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.216647 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.216932 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.217213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.217511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.217788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.218065 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.218355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.218624 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.218705 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:05.218894 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.218978 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.219163 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.219253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.219440 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.219525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.219729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.219810 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.219992 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.220083 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.220266 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.220556 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.220831 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.221105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.221512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.221794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.222066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.222331 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:05.253562 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55577e8589c0 pid: 88334 (default app) Oct 24 08:34:05.255567 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55577e8589c0 pid: 88335 (default app) Oct 24 08:34:05.256871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711e9b-980d-4f8e-a30c-ea7309ad775d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:05.257157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711e9b-980d-4f8e-a30c-ea7309ad775d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:05.257431 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711e9b-980d-4f8e-a30c-ea7309ad775d None None] PATH_INFO: `/v3` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:05.261611 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Oct 24 08:34:05 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:12.162220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839bb2-770f-4f1f-90d4-cc2c751f8587 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:12.162745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839bb2-770f-4f1f-90d4-cc2c751f8587 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:12.162745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839bb2-770f-4f1f-90d4-cc2c751f8587 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:12.167091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:12.173347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:12.173928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:12.173928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:12.246716 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: INFO dbcounter [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] Registered counter for database keystone Oct 24 08:34:12.265808 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG oslo_db.sqlalchemy.engines [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:34:12.272023 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writer thread running {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:34:12.452774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG passlib.handlers.bcrypt [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88334) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 08:34:12.453149 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG passlib.handlers.bcrypt [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88334) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 08:34:12.515194 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:12.517105 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:12.645582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:34:13.060684 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839bb2-770f-4f1f-90d4-cc2c751f8587 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:13.137032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: INFO dbcounter [None req-da839bb2-770f-4f1f-90d4-cc2c751f8587 None None] Registered counter for database keystone Oct 24 08:34:13.159773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG oslo_db.sqlalchemy.engines [None req-da839bb2-770f-4f1f-90d4-cc2c751f8587 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:34:13.165912 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writer thread running {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:34:13.286958 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839bb2-770f-4f1f-90d4-cc2c751f8587 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:13.291199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053f35e-9022-49d8-b384-f72abda5c923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:13.291827 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f35e-9022-49d8-b384-f72abda5c923 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:13.292105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f35e-9022-49d8-b384-f72abda5c923 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:13.292375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f35e-9022-49d8-b384-f72abda5c923 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:13.302803 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053f35e-9022-49d8-b384-f72abda5c923 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:13.354661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a053f35e-9022-49d8-b384-f72abda5c923 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 08:34:13.355046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053f35e-9022-49d8-b384-f72abda5c923 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:13.365637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Oct 24 08:34:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 08:34:13.371801 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:13.389002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf334-99b6-41b6-a651-15bac9ff3c79 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:13.393384 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36cb8f-e839-4aee-8933-6a6305cae7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:13.394505 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36cb8f-e839-4aee-8933-6a6305cae7ce admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:13.394790 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36cb8f-e839-4aee-8933-6a6305cae7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:13.395062 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36cb8f-e839-4aee-8933-6a6305cae7ce admin admin] PATH_INFO: `/v3/projects/cecb417d1d674088b180055893a0ccca` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:13.398871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36cb8f-e839-4aee-8933-6a6305cae7ce admin admin] RBAC: Authorizing `identity:get_project(project_id=cecb417d1d674088b180055893a0ccca)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:13.448929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a36cb8f-e839-4aee-8933-6a6305cae7ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 08:34:13.449277 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36cb8f-e839-4aee-8933-6a6305cae7ce admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:13.454360 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 24 08:34:13 2022] GET /identity/v3/projects/cecb417d1d674088b180055893a0ccca => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:15.622569 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52775a-2846-4869-8a0c-b1fa8370356e None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:15.623093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52775a-2846-4869-8a0c-b1fa8370356e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:15.623093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52775a-2846-4869-8a0c-b1fa8370356e None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:15.627197 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:15.632829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00058285-9a71-40be-a95a-0202638d40e9 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:15.633263 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00058285-9a71-40be-a95a-0202638d40e9 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:15.633381 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00058285-9a71-40be-a95a-0202638d40e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:15.655439 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-00058285-9a71-40be-a95a-0202638d40e9 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:15.656978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-00058285-9a71-40be-a95a-0202638d40e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:15.664817 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:34:15.937412 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52775a-2846-4869-8a0c-b1fa8370356e None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:15.949326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52775a-2846-4869-8a0c-b1fa8370356e None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:15.953831 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321b96a-0d03-4545-9a30-f8a361ba9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:15.954455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321b96a-0d03-4545-9a30-f8a361ba9810 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:15.954732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321b96a-0d03-4545-9a30-f8a361ba9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:15.955003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321b96a-0d03-4545-9a30-f8a361ba9810 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:15.962554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321b96a-0d03-4545-9a30-f8a361ba9810 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:15.964320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321b96a-0d03-4545-9a30-f8a361ba9810 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:15.973994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Oct 24 08:34:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:34:15.979749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00058285-9a71-40be-a95a-0202638d40e9 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:15.990038 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00058285-9a71-40be-a95a-0202638d40e9 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:15.994348 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d41d6e-b168-41d3-ae1f-a824d189b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:15.994972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41d6e-b168-41d3-ae1f-a824d189b130 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:15.995249 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41d6e-b168-41d3-ae1f-a824d189b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:15.995519 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41d6e-b168-41d3-ae1f-a824d189b130 admin admin] PATH_INFO: `/v3/users/eb436ff244d04b3cb3470051690a8e72` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:15.997507 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d41d6e-b168-41d3-ae1f-a824d189b130 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb436ff244d04b3cb3470051690a8e72)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:15.999409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d41d6e-b168-41d3-ae1f-a824d189b130 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:16.001012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Oct 24 08:34:15 2022] GET /identity/v3/users/eb436ff244d04b3cb3470051690a8e72 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:18.235590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93138-6d3e-4da4-81d7-5043e32f8d9a None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:18.236099 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93138-6d3e-4da4-81d7-5043e32f8d9a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:18.236099 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93138-6d3e-4da4-81d7-5043e32f8d9a None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:18.237362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:18.242955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423d67-6223-415d-9915-fc8245d04267 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:18.243348 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423d67-6223-415d-9915-fc8245d04267 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:18.243496 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423d67-6223-415d-9915-fc8245d04267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:18.261349 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-f5423d67-6223-415d-9915-fc8245d04267 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:18.262671 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f5423d67-6223-415d-9915-fc8245d04267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:18.302562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcf25b-3a66-4ef0-ae58-6dd9a09d290e None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:18.302944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcf25b-3a66-4ef0-ae58-6dd9a09d290e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:18.303221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcf25b-3a66-4ef0-ae58-6dd9a09d290e None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:18.304528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:18.309881 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:18.310159 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:18.310429 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:18.349204 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:18.352258 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG passlib.handlers.bcrypt [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88335) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 08:34:18.352662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG passlib.handlers.bcrypt [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88335) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 08:34:18.402115 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:18.404514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:18.507364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:18.618398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5423d67-6223-415d-9915-fc8245d04267 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:18.642761 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:18.726407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5423d67-6223-415d-9915-fc8245d04267 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:18.759518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60110a24-6246-4401-89c4-62f609f0aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:18.760148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60110a24-6246-4401-89c4-62f609f0aff7 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:18.760421 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60110a24-6246-4401-89c4-62f609f0aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:18.760688 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60110a24-6246-4401-89c4-62f609f0aff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:18.772511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60110a24-6246-4401-89c4-62f609f0aff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:18.778107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-60110a24-6246-4401-89c4-62f609f0aff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:18.781465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:18.782403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:18.783185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:34:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:34:18.788441 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60110a24-6246-4401-89c4-62f609f0aff7 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:18.874663 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:18.885553 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab7f6a-525e-401c-a44d-728ce95fa8a9 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:18.887846 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:18.894010 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60110a24-6246-4401-89c4-62f609f0aff7 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:18.925375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:18.926314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:18.926613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:18.926865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:18.927851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:18.928151 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:18.928750 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:18.929025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:18.929282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:18.929366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:18.929976 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:18.930274 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:18.931644 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:18.941630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.sql.core [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:34:18.941630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:34:18.941630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [parameters: {'id': '7b08be87c46e4a77932782336c115d81', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 08:34:18.941630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88335) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:34:18.944812 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:18.950915 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:34:18.960230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result.read() Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 08:34:18.961209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application yield resource Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise self.value Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application session.commit() Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:34:18.962484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:34:18.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:34:18.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result.read() Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:34:18.966093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [parameters: {'id': '7b08be87c46e4a77932782336c115d81', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 08:34:18.966949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:18.969292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 8/16] 10.222.0.23 () {60 vars in 1137 bytes} [Mon Oct 24 08:34:18 2022] POST /identity/v3/domains => generated 190 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:34:18.971947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:19.061058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239df7d-3a5e-4b9f-80e0-7a1f6a36342b None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:19.072511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1d62-57c0-4c6e-a45b-11052bf1dc0d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:19.095711 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7109c9-f268-4fba-9325-608308cadb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:19.096345 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7109c9-f268-4fba-9325-608308cadb19 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:19.096631 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7109c9-f268-4fba-9325-608308cadb19 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:19.096904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7109c9-f268-4fba-9325-608308cadb19 None admin] PATH_INFO: `/v3/users/eb436ff244d04b3cb3470051690a8e72` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:19.098071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7109c9-f268-4fba-9325-608308cadb19 None admin] RBAC: Authorizing `identity:get_user(user_id=eb436ff244d04b3cb3470051690a8e72)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:19.099560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7109c9-f268-4fba-9325-608308cadb19 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:19.101133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:18 2022] GET /identity/v3/users/eb436ff244d04b3cb3470051690a8e72 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:19.106790 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7109c9-f268-4fba-9325-608308cadb19 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:19.107786 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:19.108639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:19.108912 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:19.109178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:19.122490 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:19.128095 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:19.129591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:34:19.148616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:19.149676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:34:19.150497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:34:19.150497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:34:19.150497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:19.150497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:34:19.156639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:19.179828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:19.212003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7109c9-f268-4fba-9325-608308cadb19 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:19.247677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c3ff4-856c-45e0-98d2-52be3177ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:19.248301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3ff4-856c-45e0-98d2-52be3177ac6e None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:19.248573 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3ff4-856c-45e0-98d2-52be3177ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:19.248838 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3ff4-856c-45e0-98d2-52be3177ac6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:19.250000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c3ff4-856c-45e0-98d2-52be3177ac6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:19.251456 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c3ff4-856c-45e0-98d2-52be3177ac6e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:19.253004 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:19.258838 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c3ff4-856c-45e0-98d2-52be3177ac6e None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:19.260277 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab7a1d-d41f-4320-96fb-92674b35c0fc None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:19.300138 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf96c34-6757-4061-8e1d-8a3836143181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:19.300749 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96c34-6757-4061-8e1d-8a3836143181 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:19.301024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96c34-6757-4061-8e1d-8a3836143181 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:19.301291 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96c34-6757-4061-8e1d-8a3836143181 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:19.302068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf96c34-6757-4061-8e1d-8a3836143181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:19.302464 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf96c34-6757-4061-8e1d-8a3836143181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:19.303882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf96c34-6757-4061-8e1d-8a3836143181 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:19.322027 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:19.359228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:19.380121 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c3ff4-856c-45e0-98d2-52be3177ac6e None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:19.417725 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdce07b-3e82-4359-94e1-3cc264f266e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:19.418398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce07b-3e82-4359-94e1-3cc264f266e0 None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:19.418860 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce07b-3e82-4359-94e1-3cc264f266e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:19.419802 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce07b-3e82-4359-94e1-3cc264f266e0 None admin] PATH_INFO: `/v3/domains/default/users/eb436ff244d04b3cb3470051690a8e72/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:19.421856 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdce07b-3e82-4359-94e1-3cc264f266e0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eb436ff244d04b3cb3470051690a8e72, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:19.423315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdce07b-3e82-4359-94e1-3cc264f266e0 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:19.541864 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Oct 24 08:34:19 2022] PUT /identity/v3/domains/default/users/eb436ff244d04b3cb3470051690a8e72/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:34:21.838966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcd13e-624a-4ce5-915e-2c0aa921c629 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:21.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcd13e-624a-4ce5-915e-2c0aa921c629 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:21.840656 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcd13e-624a-4ce5-915e-2c0aa921c629 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:21.842814 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:21.848831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b9c24-470d-4989-ada6-b83e98021b0f None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:21.849336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b9c24-470d-4989-ada6-b83e98021b0f None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:21.849407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b9c24-470d-4989-ada6-b83e98021b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:21.882585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-8a5b9c24-470d-4989-ada6-b83e98021b0f None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:21.884111 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-8a5b9c24-470d-4989-ada6-b83e98021b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:21.989073 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:22.181153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a16ad-89c8-483b-955d-89bcd629920f None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.181821 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a16ad-89c8-483b-955d-89bcd629920f None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.182327 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a16ad-89c8-483b-955d-89bcd629920f None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.184150 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:22.189884 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715759f9-c966-4c3d-9f59-639fcf424c01 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.190171 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715759f9-c966-4c3d-9f59-639fcf424c01 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.190450 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715759f9-c966-4c3d-9f59-639fcf424c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.218512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-715759f9-c966-4c3d-9f59-639fcf424c01 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:22.219722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-715759f9-c966-4c3d-9f59-639fcf424c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:22.275977 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19a22d-965b-4a64-8073-87ad061de4e3 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.276583 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19a22d-965b-4a64-8073-87ad061de4e3 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.277053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19a22d-965b-4a64-8073-87ad061de4e3 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.279601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:22.286238 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7277-6c43-4ea8-aa2d-563d69155ef0 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.286920 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7277-6c43-4ea8-aa2d-563d69155ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.287392 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7277-6c43-4ea8-aa2d-563d69155ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.321948 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:22.327901 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:22.328776 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715759f9-c966-4c3d-9f59-639fcf424c01 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:22.328888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-5fcc7277-6c43-4ea8-aa2d-563d69155ef0 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:22.330169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-5fcc7277-6c43-4ea8-aa2d-563d69155ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:22.454729 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:22.537187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715759f9-c966-4c3d-9f59-639fcf424c01 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:22.578964 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4329-e529-4d9e-9967-76579adfb5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:22.579612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4329-e529-4d9e-9967-76579adfb5f2 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.579892 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4329-e529-4d9e-9967-76579adfb5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.580166 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4329-e529-4d9e-9967-76579adfb5f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.592679 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4329-e529-4d9e-9967-76579adfb5f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:22.594412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4329-e529-4d9e-9967-76579adfb5f2 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-c2bb4329-e529-4d9e-9967-76579adfb5f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:34:22.621158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:22.622129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:34:22.622901 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:34:22.622901 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:34:22.622901 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:22.622901 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 14/28] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:22.629047 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc7277-6c43-4ea8-aa2d-563d69155ef0 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:22.650382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:22.713017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765d62-7c4c-4292-ac83-85b386673414 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.713549 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765d62-7c4c-4292-ac83-85b386673414 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.713974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765d62-7c4c-4292-ac83-85b386673414 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.718835 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 15/29] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:22.724273 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f346d-d6ad-4d58-82a7-ac62ffd1baff None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.724858 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f346d-d6ad-4d58-82a7-ac62ffd1baff None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.725334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f346d-d6ad-4d58-82a7-ac62ffd1baff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.746989 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc7277-6c43-4ea8-aa2d-563d69155ef0 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:22.762591 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-6b8f346d-d6ad-4d58-82a7-ac62ffd1baff None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:22.764098 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6b8f346d-d6ad-4d58-82a7-ac62ffd1baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:22.781869 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:22.782479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.782755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.783024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.783673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:22.783975 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:22.785347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:22.801839 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:22.803227 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:22.860199 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:22.880787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:22.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 16/31] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:22.907515 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d49a30-e051-44a3-a6cf-a248a68c57b7 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:22.911737 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f346d-d6ad-4d58-82a7-ac62ffd1baff None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:22.943924 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9b14c-54af-47c3-bcb7-f3be5a405521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:22.944542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b14c-54af-47c3-bcb7-f3be5a405521 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:22.944820 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b14c-54af-47c3-bcb7-f3be5a405521 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:22.945091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b14c-54af-47c3-bcb7-f3be5a405521 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:22.945782 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9b14c-54af-47c3-bcb7-f3be5a405521 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:22.947228 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9b14c-54af-47c3-bcb7-f3be5a405521 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:23.037968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f346d-d6ad-4d58-82a7-ac62ffd1baff None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:23.073930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287ea8-129f-4178-965d-6fbd223c105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:23.074622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287ea8-129f-4178-965d-6fbd223c105a None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:23.075465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287ea8-129f-4178-965d-6fbd223c105a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:23.075874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287ea8-129f-4178-965d-6fbd223c105a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:23.087093 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec287ea8-129f-4178-965d-6fbd223c105a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-ec287ea8-129f-4178-965d-6fbd223c105a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:23.092495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:23.094177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:34:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:34:23.095729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287ea8-129f-4178-965d-6fbd223c105a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:23.161816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 16/33] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:34:22 2022] POST /identity/v3/projects => generated 301 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:34:23.161816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9b14c-54af-47c3-bcb7-f3be5a405521 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:23.189050 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:23.342270 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287ea8-129f-4178-965d-6fbd223c105a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:23.368927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9b14c-54af-47c3-bcb7-f3be5a405521 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:23.414750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:23.433383 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f39b1-1539-411c-8d69-b94fceb54486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:23.435020 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f39b1-1539-411c-8d69-b94fceb54486 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:23.435906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:23.436561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f39b1-1539-411c-8d69-b94fceb54486 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:23.437646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f39b1-1539-411c-8d69-b94fceb54486 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:23.437849 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:23.439123 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f39b1-1539-411c-8d69-b94fceb54486 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:23.439342 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:23.439869 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:23.440788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:23.442506 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f39b1-1539-411c-8d69-b94fceb54486 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:23.445943 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:23.447519 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:23.461546 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 18/34] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 24 08:34:23 2022] POST /identity/v3/roles => generated 219 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:23.462738 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f39b1-1539-411c-8d69-b94fceb54486 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:23.470573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 17/35] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:23.483499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:23.597094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f39b1-1539-411c-8d69-b94fceb54486 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:23.599512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:23.607447 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf6c16-b4d2-4b9b-ab75-b0d27dc674bc None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:23.646324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680597b7-f339-48c9-be4f-cbc63986f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:23.647384 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680597b7-f339-48c9-be4f-cbc63986f90b None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:23.647883 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680597b7-f339-48c9-be4f-cbc63986f90b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:23.648284 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161200f0-7114-4fe2-8c0a-7aa19beccff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:23.648598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680597b7-f339-48c9-be4f-cbc63986f90b None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:23.648945 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161200f0-7114-4fe2-8c0a-7aa19beccff2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:23.649225 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161200f0-7114-4fe2-8c0a-7aa19beccff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:23.650045 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680597b7-f339-48c9-be4f-cbc63986f90b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:23.651687 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680597b7-f339-48c9-be4f-cbc63986f90b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:23.652836 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161200f0-7114-4fe2-8c0a-7aa19beccff2 None admin] PATH_INFO: `/v3/users/eb436ff244d04b3cb3470051690a8e72` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:23.655444 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161200f0-7114-4fe2-8c0a-7aa19beccff2 None admin] RBAC: Authorizing `identity:get_user(user_id=eb436ff244d04b3cb3470051690a8e72)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:23.656908 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161200f0-7114-4fe2-8c0a-7aa19beccff2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:23.658942 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 18/36] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:23 2022] GET /identity/v3/users/eb436ff244d04b3cb3470051690a8e72 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:23.664607 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161200f0-7114-4fe2-8c0a-7aa19beccff2 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:23.676395 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 24 08:34:23 2022] POST /identity/v3/roles => generated 225 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:23.739194 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:23.760462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094ed21-95ae-4aae-8527-a48990472734 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:23.761088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094ed21-95ae-4aae-8527-a48990472734 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:23.761622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094ed21-95ae-4aae-8527-a48990472734 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:23.763577 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 20/38] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:23.769706 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68222330-ce25-4702-b64a-b89308014259 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:23.770317 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68222330-ce25-4702-b64a-b89308014259 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:23.770796 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68222330-ce25-4702-b64a-b89308014259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:23.802907 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161200f0-7114-4fe2-8c0a-7aa19beccff2 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:23.847449 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93259b-5990-41af-a141-98c45bf75f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:23.848096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93259b-5990-41af-a141-98c45bf75f71 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:23.848375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93259b-5990-41af-a141-98c45bf75f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:23.848703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93259b-5990-41af-a141-98c45bf75f71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:23.851469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93259b-5990-41af-a141-98c45bf75f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:23.853145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93259b-5990-41af-a141-98c45bf75f71 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:23.855181 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 19/39] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:23.862020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93259b-5990-41af-a141-98c45bf75f71 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:23.922884 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-68222330-ce25-4702-b64a-b89308014259 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:23.924094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-68222330-ce25-4702-b64a-b89308014259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:23.987533 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93259b-5990-41af-a141-98c45bf75f71 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:24.019235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 21/40] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:24.024930 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:24.040056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d7699-e438-4e12-9c38-eb02dc480f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:24.040675 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d7699-e438-4e12-9c38-eb02dc480f87 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:24.040949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d7699-e438-4e12-9c38-eb02dc480f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:24.041219 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d7699-e438-4e12-9c38-eb02dc480f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:24.041994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d7699-e438-4e12-9c38-eb02dc480f87 None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.domain.id=default, user.id=eb436ff244d04b3cb3470051690a8e72) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:24.042298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d7699-e438-4e12-9c38-eb02dc480f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:24.044373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d7699-e438-4e12-9c38-eb02dc480f87 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:24.053831 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 20/41] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Oct 24 08:34:23 2022] GET /identity/v3/role_assignments?user.id=eb436ff244d04b3cb3470051690a8e72&scope.domain.id=default&role.id=ebf9799815574909aa1c88e93e213c96 => generated 530 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:24.295679 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68222330-ce25-4702-b64a-b89308014259 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:24.395128 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:24.405175 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68222330-ce25-4702-b64a-b89308014259 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:24.438695 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ebf2c-e5f8-426f-9af6-d06fd54a00f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:24.439300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebf2c-e5f8-426f-9af6-d06fd54a00f7 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:24.439575 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebf2c-e5f8-426f-9af6-d06fd54a00f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:24.439844 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebf2c-e5f8-426f-9af6-d06fd54a00f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:24.440510 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ebf2c-e5f8-426f-9af6-d06fd54a00f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:24.441920 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ebf2c-e5f8-426f-9af6-d06fd54a00f7 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:24.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 24 08:34:24 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:24.468269 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde95063-8de7-43c1-a300-3a9b37012b54 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:24.468548 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde95063-8de7-43c1-a300-3a9b37012b54 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:24.468819 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde95063-8de7-43c1-a300-3a9b37012b54 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:24.470226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 21/43] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:24.476228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e77140-61fd-40c5-bf6d-729608478514 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:24.476507 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e77140-61fd-40c5-bf6d-729608478514 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:24.476781 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e77140-61fd-40c5-bf6d-729608478514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:24.497897 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-52e77140-61fd-40c5-bf6d-729608478514 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:24.499139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-52e77140-61fd-40c5-bf6d-729608478514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:24.572787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 23/44] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:24.844506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde95063-8de7-43c1-a300-3a9b37012b54 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:24.942830 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde95063-8de7-43c1-a300-3a9b37012b54 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:24.975879 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635950f-52ad-4313-bbc2-895161a44245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:24.976516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635950f-52ad-4313-bbc2-895161a44245 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:24.976797 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635950f-52ad-4313-bbc2-895161a44245 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:24.977067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635950f-52ad-4313-bbc2-895161a44245 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:24.978235 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635950f-52ad-4313-bbc2-895161a44245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:24.979709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635950f-52ad-4313-bbc2-895161a44245 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:24.981917 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 22/45] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:24.987423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e77140-61fd-40c5-bf6d-729608478514 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:25.066895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:25.086181 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e77140-61fd-40c5-bf6d-729608478514 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:25.120378 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b446235-07e2-40c3-93da-4c035206e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:25.120920 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b446235-07e2-40c3-93da-4c035206e346 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:25.121202 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b446235-07e2-40c3-93da-4c035206e346 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:25.121511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b446235-07e2-40c3-93da-4c035206e346 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:25.122265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b446235-07e2-40c3-93da-4c035206e346 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:25.123746 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b446235-07e2-40c3-93da-4c035206e346 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:25.150571 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:34:24 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:27.324361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c464f76-aade-4524-8036-799ea45606e4 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:27.324891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c464f76-aade-4524-8036-799ea45606e4 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:27.324891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c464f76-aade-4524-8036-799ea45606e4 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:27.326565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:27.332747 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca8b6-30ee-48ca-be31-83dfbbc1c326 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:27.333275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca8b6-30ee-48ca-be31-83dfbbc1c326 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:27.333372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca8b6-30ee-48ca-be31-83dfbbc1c326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:27.352034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-9c2ca8b6-30ee-48ca-be31-83dfbbc1c326 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:27.353219 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-9c2ca8b6-30ee-48ca-be31-83dfbbc1c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:27.421431 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:27.691546 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c464f76-aade-4524-8036-799ea45606e4 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:27.744280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:27.790433 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c464f76-aade-4524-8036-799ea45606e4 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:27.823678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993131b6-e86f-4a46-a1e4-c27f0450a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:27.824293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993131b6-e86f-4a46-a1e4-c27f0450a71f None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:27.824567 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993131b6-e86f-4a46-a1e4-c27f0450a71f None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:27.824832 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993131b6-e86f-4a46-a1e4-c27f0450a71f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:27.825965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993131b6-e86f-4a46-a1e4-c27f0450a71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:27.827400 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993131b6-e86f-4a46-a1e4-c27f0450a71f None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:27.828936 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 24/49] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:27.834625 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ca8b6-30ee-48ca-be31-83dfbbc1c326 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:27.895216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:27.932329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ca8b6-30ee-48ca-be31-83dfbbc1c326 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:27.964977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad79a4-191b-411c-b17b-ea1147ef006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:27.966077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad79a4-191b-411c-b17b-ea1147ef006b None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:27.966523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad79a4-191b-411c-b17b-ea1147ef006b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:27.966806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad79a4-191b-411c-b17b-ea1147ef006b None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:27.967463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad79a4-191b-411c-b17b-ea1147ef006b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:27.968915 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad79a4-191b-411c-b17b-ea1147ef006b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:27.996207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Oct 24 08:34:27 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:30.206877 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54898b-1553-4510-b5e5-e1b9d0b84680 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:30.207410 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54898b-1553-4510-b5e5-e1b9d0b84680 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:30.207410 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54898b-1553-4510-b5e5-e1b9d0b84680 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:30.208787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 25/51] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:30.213950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e411-3ca8-4248-b0ab-093e6d55280c None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:30.214368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e411-3ca8-4248-b0ab-093e6d55280c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:30.214499 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e411-3ca8-4248-b0ab-093e6d55280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:30.234831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-05f6e411-3ca8-4248-b0ab-093e6d55280c None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:30.235955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-05f6e411-3ca8-4248-b0ab-093e6d55280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:30.301160 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 27/52] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:30.570648 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54898b-1553-4510-b5e5-e1b9d0b84680 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:30.672137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54898b-1553-4510-b5e5-e1b9d0b84680 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:30.691489 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:30.704905 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f879b73-b694-46e6-8b66-e68474605c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:30.705566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f879b73-b694-46e6-8b66-e68474605c04 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:30.705847 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f879b73-b694-46e6-8b66-e68474605c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:30.706122 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f879b73-b694-46e6-8b66-e68474605c04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:30.707271 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f879b73-b694-46e6-8b66-e68474605c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:30.708689 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f879b73-b694-46e6-8b66-e68474605c04 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:30.710284 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:30.715861 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6e411-3ca8-4248-b0ab-093e6d55280c None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:30.761626 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:30.813764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6e411-3ca8-4248-b0ab-093e6d55280c None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:30.846602 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ace5f6-231e-4f3d-8963-6aafcfde10da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:30.847136 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace5f6-231e-4f3d-8963-6aafcfde10da None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:30.847416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace5f6-231e-4f3d-8963-6aafcfde10da None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:30.847686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ace5f6-231e-4f3d-8963-6aafcfde10da None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:30.848333 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ace5f6-231e-4f3d-8963-6aafcfde10da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:30.849814 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ace5f6-231e-4f3d-8963-6aafcfde10da None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:30.876789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 28/54] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:34:30 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:34.205386 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696080-ee9b-4e95-ad79-6671c548dfc5 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:34.205933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696080-ee9b-4e95-ad79-6671c548dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:34.206032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b696080-ee9b-4e95-ad79-6671c548dfc5 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:34.207307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 27/55] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:34.212922 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7359-4134-412e-8989-c8bc77fe545a None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:34.213355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7359-4134-412e-8989-c8bc77fe545a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:34.213565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c7359-4134-412e-8989-c8bc77fe545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:34.242766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-ca2c7359-4134-412e-8989-c8bc77fe545a None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:34.243957 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ca2c7359-4134-412e-8989-c8bc77fe545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:34.253351 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a647-58b5-44a8-a271-04789b7a030a None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:34.253652 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a647-58b5-44a8-a271-04789b7a030a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:34.253925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a647-58b5-44a8-a271-04789b7a030a None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:34.255373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 28/56] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:34.261287 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e442e5-7195-415e-8aef-59fc04e24a07 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:34.261867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e442e5-7195-415e-8aef-59fc04e24a07 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:34.262313 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e442e5-7195-415e-8aef-59fc04e24a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:34.334137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 29/57] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:34.341478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8438e9-a3fc-497f-8609-1c7e2c12f8cf None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:34.342335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8438e9-a3fc-497f-8609-1c7e2c12f8cf None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:34.342870 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8438e9-a3fc-497f-8609-1c7e2c12f8cf None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:34.344542 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:34.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f0a7-661d-4c70-9645-76806349e0d4 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:34.355860 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f0a7-661d-4c70-9645-76806349e0d4 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:34.356317 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2f0a7-661d-4c70-9645-76806349e0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:34.400628 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-73e2f0a7-661d-4c70-9645-76806349e0d4 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:34.402200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-73e2f0a7-661d-4c70-9645-76806349e0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:34.410459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-47e442e5-7195-415e-8aef-59fc04e24a07 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:34.412003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-47e442e5-7195-415e-8aef-59fc04e24a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:34.431017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:34.479856 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 31/59] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 24 08:34:34.552003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 29/60] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:34.706760 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f0a7-661d-4c70-9645-76806349e0d4 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:34.810682 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e442e5-7195-415e-8aef-59fc04e24a07 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:34.847261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2f0a7-661d-4c70-9645-76806349e0d4 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:34.916088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e093-7f3d-48d7-a2ea-4ef9d81bc739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:34.916741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e093-7f3d-48d7-a2ea-4ef9d81bc739 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:34.917020 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e093-7f3d-48d7-a2ea-4ef9d81bc739 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:34.917294 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e093-7f3d-48d7-a2ea-4ef9d81bc739 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:34.937001 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214e093-7f3d-48d7-a2ea-4ef9d81bc739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-9214e093-7f3d-48d7-a2ea-4ef9d81bc739 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:34.941952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:34.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:34.943683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 32/61] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:34.944324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e093-7f3d-48d7-a2ea-4ef9d81bc739 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:34.971154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:34.995462 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e442e5-7195-415e-8aef-59fc04e24a07 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.018609 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:35.048360 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b3ee7-684b-42ca-95d1-e6e87949ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.049015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b3ee7-684b-42ca-95d1-e6e87949ee33 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.049304 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b3ee7-684b-42ca-95d1-e6e87949ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.049610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b3ee7-684b-42ca-95d1-e6e87949ee33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.061637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b3ee7-684b-42ca-95d1-e6e87949ee33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-ef5b3ee7-684b-42ca-95d1-e6e87949ee33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:35.067948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:35.068780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:35.069604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 30/62] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:34:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:35.070290 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b3ee7-684b-42ca-95d1-e6e87949ee33 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.080702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e093-7f3d-48d7-a2ea-4ef9d81bc739 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.118030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e357b6-919d-4d45-bac2-bb576a81b2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.118670 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e357b6-919d-4d45-bac2-bb576a81b2fa None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.118952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e357b6-919d-4d45-bac2-bb576a81b2fa None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.119227 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e357b6-919d-4d45-bac2-bb576a81b2fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.130454 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e357b6-919d-4d45-bac2-bb576a81b2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-d3e357b6-919d-4d45-bac2-bb576a81b2fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:35.135261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:35.136097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:35.137284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 33/63] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:34:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:35.138153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50496f78-aefd-4fbb-8ce0-52672a25194a None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.138153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50496f78-aefd-4fbb-8ce0-52672a25194a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.138419 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50496f78-aefd-4fbb-8ce0-52672a25194a None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.140339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 34/64] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:35.144854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50496f78-aefd-4fbb-8ce0-52672a25194a None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.176339 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b3ee7-684b-42ca-95d1-e6e87949ee33 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.210129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32ae67-9bf9-4eb7-90b4-b4d0a5553db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.210754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32ae67-9bf9-4eb7-90b4-b4d0a5553db8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.210999 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32ae67-9bf9-4eb7-90b4-b4d0a5553db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.211265 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32ae67-9bf9-4eb7-90b4-b4d0a5553db8 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.211959 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32ae67-9bf9-4eb7-90b4-b4d0a5553db8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:35.212253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32ae67-9bf9-4eb7-90b4-b4d0a5553db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:35.213713 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32ae67-9bf9-4eb7-90b4-b4d0a5553db8 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:35.222113 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 31/65] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:35.223290 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11004-7620-4c62-9cb6-0046676f5858 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.223569 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11004-7620-4c62-9cb6-0046676f5858 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.223840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11004-7620-4c62-9cb6-0046676f5858 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.225192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 32/66] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:35.225736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab11004-7620-4c62-9cb6-0046676f5858 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.233757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:35.255852 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50496f78-aefd-4fbb-8ce0-52672a25194a None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.270821 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:35.293224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df51ac8-b7f6-4872-ad57-dca8156f0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.294372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df51ac8-b7f6-4872-ad57-dca8156f0095 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.294653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df51ac8-b7f6-4872-ad57-dca8156f0095 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.294934 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df51ac8-b7f6-4872-ad57-dca8156f0095 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.295672 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df51ac8-b7f6-4872-ad57-dca8156f0095 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:35.295975 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df51ac8-b7f6-4872-ad57-dca8156f0095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:35.297374 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df51ac8-b7f6-4872-ad57-dca8156f0095 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:35.305368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 35/67] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:35.306572 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cc9b9-0c8f-4ac0-8cad-5a6a7d23c764 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.306858 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cc9b9-0c8f-4ac0-8cad-5a6a7d23c764 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.307141 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cc9b9-0c8f-4ac0-8cad-5a6a7d23c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.325298 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-386cc9b9-0c8f-4ac0-8cad-5a6a7d23c764 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:35.326449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-386cc9b9-0c8f-4ac0-8cad-5a6a7d23c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:35.334882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab11004-7620-4c62-9cb6-0046676f5858 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.368455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.369070 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.369350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.369647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:35.370610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:35.372283 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:35.380535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 33/68] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:35.381333 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.393976 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:35.405665 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45e42-50de-40d0-958c-c82ad460f0a3 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.405665 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45e42-50de-40d0-958c-c82ad460f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.405665 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45e42-50de-40d0-958c-c82ad460f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.417729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-eae45e42-50de-40d0-958c-c82ad460f0a3 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:35.419021 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-eae45e42-50de-40d0-958c-c82ad460f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:35.487714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d77a-269e-4df8-a181-4d7b7533ac6d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.489814 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:35.503245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 37/70] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:35.503245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45e42-50de-40d0-958c-c82ad460f0a3 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.506138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:35.548153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae015b-1e9c-41e2-acfc-5d15cfd1069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.549566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae015b-1e9c-41e2-acfc-5d15cfd1069d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.550380 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae015b-1e9c-41e2-acfc-5d15cfd1069d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.551204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae015b-1e9c-41e2-acfc-5d15cfd1069d None admin] PATH_INFO: `/v3/users/7489ba24403840d28228fe5a47b9b63d` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.582087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae015b-1e9c-41e2-acfc-5d15cfd1069d None admin] RBAC: Authorizing `identity:get_user(user_id=7489ba24403840d28228fe5a47b9b63d)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:35.585577 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae015b-1e9c-41e2-acfc-5d15cfd1069d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:35.589061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 34/71] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/users/7489ba24403840d28228fe5a47b9b63d => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:35.590835 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae015b-1e9c-41e2-acfc-5d15cfd1069d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.636319 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45e42-50de-40d0-958c-c82ad460f0a3 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.703705 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da65ac-3913-4758-8d41-49c40bfd3ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.704371 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da65ac-3913-4758-8d41-49c40bfd3ddc None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.704693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da65ac-3913-4758-8d41-49c40bfd3ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.704964 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da65ac-3913-4758-8d41-49c40bfd3ddc None admin] PATH_INFO: `/v3/users/7489ba24403840d28228fe5a47b9b63d` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.706592 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da65ac-3913-4758-8d41-49c40bfd3ddc None admin] RBAC: Authorizing `identity:get_user(user_id=7489ba24403840d28228fe5a47b9b63d)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:35.709246 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da65ac-3913-4758-8d41-49c40bfd3ddc None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:35.717646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 38/72] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/users/7489ba24403840d28228fe5a47b9b63d => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:35.717646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da65ac-3913-4758-8d41-49c40bfd3ddc None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.735252 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae015b-1e9c-41e2-acfc-5d15cfd1069d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.783251 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdba8b-26a5-4637-bd43-f0ac0183c662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.783912 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdba8b-26a5-4637-bd43-f0ac0183c662 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.784192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdba8b-26a5-4637-bd43-f0ac0183c662 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.784467 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdba8b-26a5-4637-bd43-f0ac0183c662 None admin] PATH_INFO: `/v3/users/eb436ff244d04b3cb3470051690a8e72` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.785645 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdba8b-26a5-4637-bd43-f0ac0183c662 None admin] RBAC: Authorizing `identity:get_user(user_id=eb436ff244d04b3cb3470051690a8e72)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:35.787555 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdba8b-26a5-4637-bd43-f0ac0183c662 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:35.789165 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 35/73] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/users/eb436ff244d04b3cb3470051690a8e72 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:35.789953 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdba8b-26a5-4637-bd43-f0ac0183c662 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.813047 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:35.819896 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:35.855856 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da65ac-3913-4758-8d41-49c40bfd3ddc None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.900910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1fcf4-fd9b-450f-8d3d-8c20cc4b2895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.901582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1fcf4-fd9b-450f-8d3d-8c20cc4b2895 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.901864 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1fcf4-fd9b-450f-8d3d-8c20cc4b2895 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.902141 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1fcf4-fd9b-450f-8d3d-8c20cc4b2895 None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1fcf4-fd9b-450f-8d3d-8c20cc4b2895 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:35.905181 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1fcf4-fd9b-450f-8d3d-8c20cc4b2895 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:35.906868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 39/74] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:35.907631 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1fcf4-fd9b-450f-8d3d-8c20cc4b2895 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:35.913825 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdba8b-26a5-4637-bd43-f0ac0183c662 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:35.949391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17eb0b-7c15-45fd-8808-23ee7db67224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:35.950052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17eb0b-7c15-45fd-8808-23ee7db67224 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:35.950940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17eb0b-7c15-45fd-8808-23ee7db67224 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:35.951229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17eb0b-7c15-45fd-8808-23ee7db67224 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:35.961560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17eb0b-7c15-45fd-8808-23ee7db67224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-2a17eb0b-7c15-45fd-8808-23ee7db67224 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:35.966822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:35.967683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:35.968450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:35.971052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 36/75] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:35.971887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17eb0b-7c15-45fd-8808-23ee7db67224 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.019059 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1fcf4-fd9b-450f-8d3d-8c20cc4b2895 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.052821 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11010cb-96e9-45f6-8f68-d4326e67c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.053469 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11010cb-96e9-45f6-8f68-d4326e67c2de None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.053756 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11010cb-96e9-45f6-8f68-d4326e67c2de None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.054028 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11010cb-96e9-45f6-8f68-d4326e67c2de None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.055143 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11010cb-96e9-45f6-8f68-d4326e67c2de None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.056583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11010cb-96e9-45f6-8f68-d4326e67c2de None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.058232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 40/76] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:36.059070 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11010cb-96e9-45f6-8f68-d4326e67c2de None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.068060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:36.070048 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:36.081739 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17eb0b-7c15-45fd-8808-23ee7db67224 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.117181 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f1dae-430c-4cb6-877c-753da7d18eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.117768 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f1dae-430c-4cb6-877c-753da7d18eab None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.118050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f1dae-430c-4cb6-877c-753da7d18eab None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.118324 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f1dae-430c-4cb6-877c-753da7d18eab None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.119593 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f1dae-430c-4cb6-877c-753da7d18eab None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.121054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f1dae-430c-4cb6-877c-753da7d18eab None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.123353 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 37/77] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:35 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:36.124100 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f1dae-430c-4cb6-877c-753da7d18eab None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.166083 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11010cb-96e9-45f6-8f68-d4326e67c2de None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.201729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee01d0-5816-49c9-8a97-de29dd5762c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.202357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee01d0-5816-49c9-8a97-de29dd5762c2 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.202637 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee01d0-5816-49c9-8a97-de29dd5762c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.202909 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee01d0-5816-49c9-8a97-de29dd5762c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.204055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee01d0-5816-49c9-8a97-de29dd5762c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.205527 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee01d0-5816-49c9-8a97-de29dd5762c2 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.207095 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 41/78] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:36.207853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee01d0-5816-49c9-8a97-de29dd5762c2 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.230341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f1dae-430c-4cb6-877c-753da7d18eab None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.266428 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581781e-5703-4290-baae-212175ec7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.267093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581781e-5703-4290-baae-212175ec7a35 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.267371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581781e-5703-4290-baae-212175ec7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.267647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581781e-5703-4290-baae-212175ec7a35 None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e/users/7489ba24403840d28228fe5a47b9b63d/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.269627 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581781e-5703-4290-baae-212175ec7a35 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ee02727048b419d8fdf7b23539e940e, user_id=7489ba24403840d28228fe5a47b9b63d, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.271350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581781e-5703-4290-baae-212175ec7a35 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.286426 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 38/79] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:36 2022] PUT /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e/users/7489ba24403840d28228fe5a47b9b63d/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:34:36.287741 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581781e-5703-4290-baae-212175ec7a35 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.288899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:36.319655 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee01d0-5816-49c9-8a97-de29dd5762c2 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.321345 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:36.365118 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.365897 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.366176 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.366449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.367130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] RBAC: Adding query filter params (name=member) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:36.367484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.368977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.379687 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 42/80] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:36.381799 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.432838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581781e-5703-4290-baae-212175ec7a35 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.481648 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73185b7-ed98-470b-abd0-6a7a9a0b6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.482479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73185b7-ed98-470b-abd0-6a7a9a0b6938 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.482778 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73185b7-ed98-470b-abd0-6a7a9a0b6938 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.483036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73185b7-ed98-470b-abd0-6a7a9a0b6938 None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e/users/7489ba24403840d28228fe5a47b9b63d/roles/02120488143f46a0aeda93d292f562c5` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.485720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73185b7-ed98-470b-abd0-6a7a9a0b6938 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ee02727048b419d8fdf7b23539e940e, user_id=7489ba24403840d28228fe5a47b9b63d, role_id=02120488143f46a0aeda93d292f562c5)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.487179 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73185b7-ed98-470b-abd0-6a7a9a0b6938 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.504222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6a9f-1785-47b0-b7cf-ea5a17efb803 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.509571 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 39/81] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:36 2022] PUT /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e/users/7489ba24403840d28228fe5a47b9b63d/roles/02120488143f46a0aeda93d292f562c5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:34:36.510722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73185b7-ed98-470b-abd0-6a7a9a0b6938 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.572699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec8030-2bbc-4aa6-a3df-be368e3b0b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.573412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec8030-2bbc-4aa6-a3df-be368e3b0b0b None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.573737 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec8030-2bbc-4aa6-a3df-be368e3b0b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.574060 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec8030-2bbc-4aa6-a3df-be368e3b0b0b None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e/users/eb436ff244d04b3cb3470051690a8e72/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.576956 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec8030-2bbc-4aa6-a3df-be368e3b0b0b None admin] RBAC: Authorizing `identity:create_grant(project_id=7ee02727048b419d8fdf7b23539e940e, user_id=eb436ff244d04b3cb3470051690a8e72, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.578534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec8030-2bbc-4aa6-a3df-be368e3b0b0b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.589551 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:36.597718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 43/82] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:36 2022] PUT /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e/users/eb436ff244d04b3cb3470051690a8e72/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:34:36.599065 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec8030-2bbc-4aa6-a3df-be368e3b0b0b None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.643085 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:36.675204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73185b7-ed98-470b-abd0-6a7a9a0b6938 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.734156 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6d1f7-cfac-4a81-b1ac-abbdda812b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.734789 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d1f7-cfac-4a81-b1ac-abbdda812b42 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.735071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d1f7-cfac-4a81-b1ac-abbdda812b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.735342 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d1f7-cfac-4a81-b1ac-abbdda812b42 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.736021 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6d1f7-cfac-4a81-b1ac-abbdda812b42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.737552 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6d1f7-cfac-4a81-b1ac-abbdda812b42 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.752282 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec8030-2bbc-4aa6-a3df-be368e3b0b0b None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:36.773098 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 40/83] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:34:36 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:36.799298 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72172656-080c-4054-a9ec-5d549db44af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:36.800292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72172656-080c-4054-a9ec-5d549db44af2 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:36.800764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72172656-080c-4054-a9ec-5d549db44af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:36.801200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72172656-080c-4054-a9ec-5d549db44af2 None admin] PATH_INFO: `/v3/users/7489ba24403840d28228fe5a47b9b63d` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:36.802936 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72172656-080c-4054-a9ec-5d549db44af2 None admin] RBAC: Authorizing `identity:get_user(user_id=7489ba24403840d28228fe5a47b9b63d)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:36.804698 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72172656-080c-4054-a9ec-5d549db44af2 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:36.806630 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 44/84] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:36 2022] GET /identity/v3/users/7489ba24403840d28228fe5a47b9b63d => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:36.813602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6d1f7-cfac-4a81-b1ac-abbdda812b42 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:36.963123 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6d1f7-cfac-4a81-b1ac-abbdda812b42 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:37.007826 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:37.015899 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57168d7b-0151-45da-9865-85491bb81aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:37.016619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168d7b-0151-45da-9865-85491bb81aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:37.017754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168d7b-0151-45da-9865-85491bb81aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:37.018031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57168d7b-0151-45da-9865-85491bb81aa7 None admin] PATH_INFO: `/v3/projects/9198d863465d4b6889ea4b5b5cd18017` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:37.019218 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57168d7b-0151-45da-9865-85491bb81aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=9198d863465d4b6889ea4b5b5cd18017)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:37.020696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57168d7b-0151-45da-9865-85491bb81aa7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:37.022681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 41/85] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:36 2022] GET /identity/v3/projects/9198d863465d4b6889ea4b5b5cd18017 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:37.028513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72172656-080c-4054-a9ec-5d549db44af2 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:37.106887 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:37.157157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72172656-080c-4054-a9ec-5d549db44af2 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:37.201576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e03f7-c96d-46d9-a098-c3ce3facaee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:37.202300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e03f7-c96d-46d9-a098-c3ce3facaee4 None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:37.202640 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e03f7-c96d-46d9-a098-c3ce3facaee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:37.202933 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e03f7-c96d-46d9-a098-c3ce3facaee4 None admin] PATH_INFO: `/v3/projects/9198d863465d4b6889ea4b5b5cd18017/users/7489ba24403840d28228fe5a47b9b63d/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:37.205079 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e03f7-c96d-46d9-a098-c3ce3facaee4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9198d863465d4b6889ea4b5b5cd18017, user_id=7489ba24403840d28228fe5a47b9b63d, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:37.206718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e03f7-c96d-46d9-a098-c3ce3facaee4 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:37.224375 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 45/86] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:37 2022] PUT /identity/v3/projects/9198d863465d4b6889ea4b5b5cd18017/users/7489ba24403840d28228fe5a47b9b63d/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:34:39.152126 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905271-4812-4cb0-9d2a-4e07ecd45507 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:39.152628 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905271-4812-4cb0-9d2a-4e07ecd45507 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:39.152725 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8905271-4812-4cb0-9d2a-4e07ecd45507 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:39.154818 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 42/87] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:39.160257 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef46b-75e4-49c9-b7df-0c0402e9b07c None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:39.161196 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef46b-75e4-49c9-b7df-0c0402e9b07c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:39.161709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef46b-75e4-49c9-b7df-0c0402e9b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:39.183015 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-44eef46b-75e4-49c9-b7df-0c0402e9b07c None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:39.184787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-44eef46b-75e4-49c9-b7df-0c0402e9b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:39.271790 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 46/88] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:39.830042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8905271-4812-4cb0-9d2a-4e07ecd45507 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:39.863003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f627-f9dd-492a-be4d-86035e938978 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:39.863319 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f627-f9dd-492a-be4d-86035e938978 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:39.863553 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f627-f9dd-492a-be4d-86035e938978 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:39.865153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 47/89] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:39.887327 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf3256-c8f7-485c-839a-e8d18fbb8188 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:39.887696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf3256-c8f7-485c-839a-e8d18fbb8188 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:39.887916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf3256-c8f7-485c-839a-e8d18fbb8188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:39.907883 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-a3cf3256-c8f7-485c-839a-e8d18fbb8188 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:39.909081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a3cf3256-c8f7-485c-839a-e8d18fbb8188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:39.991662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8905271-4812-4cb0-9d2a-4e07ecd45507 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:40.010623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:40.039653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 48/90] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:40.040928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3857-8f76-4af8-bc57-bf14513c816a None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.041204 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3857-8f76-4af8-bc57-bf14513c816a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.041493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3857-8f76-4af8-bc57-bf14513c816a None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.044799 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 49/91] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:40.050105 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5795b2f-9f3b-412f-a719-8b50475afedd None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.050664 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5795b2f-9f3b-412f-a719-8b50475afedd None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.051133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5795b2f-9f3b-412f-a719-8b50475afedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.056987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4edb2d-505c-486e-9787-4ab565ec4c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:40.057671 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4edb2d-505c-486e-9787-4ab565ec4c2d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.057991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4edb2d-505c-486e-9787-4ab565ec4c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.058619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4edb2d-505c-486e-9787-4ab565ec4c2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.073550 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-a5795b2f-9f3b-412f-a719-8b50475afedd None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:40.075387 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a5795b2f-9f3b-412f-a719-8b50475afedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:40.086274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4edb2d-505c-486e-9787-4ab565ec4c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-6b4edb2d-505c-486e-9787-4ab565ec4c2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:40.090293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:40.091991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:40.092732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 43/92] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:40.101872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4edb2d-505c-486e-9787-4ab565ec4c2d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:40.229224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 50/93] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:40.250351 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:40.315676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4edb2d-505c-486e-9787-4ab565ec4c2d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:40.330324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbc57-37f1-4dd4-917e-0a15a012b578 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.330628 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbc57-37f1-4dd4-917e-0a15a012b578 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.330874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cbc57-37f1-4dd4-917e-0a15a012b578 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.332414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 51/94] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:40.339117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4222-d2b8-4233-aa21-89328405a1fe None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.339388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4222-d2b8-4233-aa21-89328405a1fe None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.339591 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4222-d2b8-4233-aa21-89328405a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.360241 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-c5aa4222-d2b8-4233-aa21-89328405a1fe None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:40.361464 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-c5aa4222-d2b8-4233-aa21-89328405a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:40.372734 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:40.373371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.373680 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.373959 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.374641 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] RBAC: Adding query filter params (name=member) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:40.374954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:40.376364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:40.392851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 44/95] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:40.399889 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:40.524938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 52/96] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:40.559002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15020c53-25ad-41f6-87dd-4602e633b856 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.559763 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15020c53-25ad-41f6-87dd-4602e633b856 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.560237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15020c53-25ad-41f6-87dd-4602e633b856 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.562032 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 53/97] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:40.571916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97e715-6285-4fc5-a0fd-d3e7b7a42527 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.572519 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97e715-6285-4fc5-a0fd-d3e7b7a42527 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.572991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97e715-6285-4fc5-a0fd-d3e7b7a42527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.583746 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c83b0-aab7-4d01-b62f-7c6c2d5d877c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:40.611741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-4d97e715-6285-4fc5-a0fd-d3e7b7a42527 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:40.613036 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4d97e715-6285-4fc5-a0fd-d3e7b7a42527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:40.632271 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:40.643537 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019737d4-08ba-43bf-85f1-98eb6e2ad061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:40.644181 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019737d4-08ba-43bf-85f1-98eb6e2ad061 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.644457 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019737d4-08ba-43bf-85f1-98eb6e2ad061 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.644726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019737d4-08ba-43bf-85f1-98eb6e2ad061 None admin] PATH_INFO: `/v3/users/7489ba24403840d28228fe5a47b9b63d` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.645944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019737d4-08ba-43bf-85f1-98eb6e2ad061 None admin] RBAC: Authorizing `identity:get_user(user_id=7489ba24403840d28228fe5a47b9b63d)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:40.647410 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019737d4-08ba-43bf-85f1-98eb6e2ad061 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:40.649030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 45/98] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:40 2022] GET /identity/v3/users/7489ba24403840d28228fe5a47b9b63d => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:40.649915 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019737d4-08ba-43bf-85f1-98eb6e2ad061 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:40.674119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:40.714180 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 54/99] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:40.715452 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97e715-6285-4fc5-a0fd-d3e7b7a42527 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:40.840524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019737d4-08ba-43bf-85f1-98eb6e2ad061 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:40.861386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97e715-6285-4fc5-a0fd-d3e7b7a42527 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:40.885297 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de338f1-9cbb-42b4-9321-99ebd2485e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:40.886180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de338f1-9cbb-42b4-9321-99ebd2485e8b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.886469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de338f1-9cbb-42b4-9321-99ebd2485e8b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.886751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de338f1-9cbb-42b4-9321-99ebd2485e8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.899571 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de338f1-9cbb-42b4-9321-99ebd2485e8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-3de338f1-9cbb-42b4-9321-99ebd2485e8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:40.905809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:40.906792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:40.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:40.908714 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c425d6e-f846-41af-9209-c7dc2bfcc689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:40.909356 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425d6e-f846-41af-9209-c7dc2bfcc689 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.909666 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425d6e-f846-41af-9209-c7dc2bfcc689 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.909935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425d6e-f846-41af-9209-c7dc2bfcc689 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.910222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 46/100] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:40.911128 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de338f1-9cbb-42b4-9321-99ebd2485e8b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:40.926239 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c425d6e-f846-41af-9209-c7dc2bfcc689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-0c425d6e-f846-41af-9209-c7dc2bfcc689 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:40.931207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:40.932253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:40.933127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 55/101] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:34:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:40.934132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6060d2-ae1f-43e1-b5b4-30d9b0bb999b None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:40.934264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6060d2-ae1f-43e1-b5b4-30d9b0bb999b None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:40.934624 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6060d2-ae1f-43e1-b5b4-30d9b0bb999b None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:40.937494 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 56/102] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:40.937494 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6060d2-ae1f-43e1-b5b4-30d9b0bb999b None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:40.983722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:40.989341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:41.043490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de338f1-9cbb-42b4-9321-99ebd2485e8b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.058386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6060d2-ae1f-43e1-b5b4-30d9b0bb999b None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.080995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d592-b3e0-4a9b-a218-8fde7aec6f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.081655 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d592-b3e0-4a9b-a218-8fde7aec6f42 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.081932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d592-b3e0-4a9b-a218-8fde7aec6f42 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.082208 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d592-b3e0-4a9b-a218-8fde7aec6f42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.098508 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25950563-c095-49b0-a1c4-3068ef64c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.099148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950563-c095-49b0-a1c4-3068ef64c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.099432 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950563-c095-49b0-a1c4-3068ef64c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.099701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25950563-c095-49b0-a1c4-3068ef64c9e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.111548 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25950563-c095-49b0-a1c4-3068ef64c9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-25950563-c095-49b0-a1c4-3068ef64c9e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:41.116635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:41.117677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 57/103] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:41.118651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25950563-c095-49b0-a1c4-3068ef64c9e0 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.157386 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d592-b3e0-4a9b-a218-8fde7aec6f42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:41.158837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d592-b3e0-4a9b-a218-8fde7aec6f42 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:41.212668 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:41.216766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:41.223421 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25950563-c095-49b0-a1c4-3068ef64c9e0 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.264649 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28b928-1980-4e54-ae6f-7a30efda39db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.265394 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28b928-1980-4e54-ae6f-7a30efda39db None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.265551 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28b928-1980-4e54-ae6f-7a30efda39db None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.265818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28b928-1980-4e54-ae6f-7a30efda39db None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.266485 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28b928-1980-4e54-ae6f-7a30efda39db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:41.266754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 47/104] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:34:41.267115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28b928-1980-4e54-ae6f-7a30efda39db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:41.267601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d592-b3e0-4a9b-a218-8fde7aec6f42 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.268171 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28b928-1980-4e54-ae6f-7a30efda39db None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:41.279668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 58/105] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:41.280880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac459-96fa-4f84-80cb-785dbedd6a95 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.281160 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac459-96fa-4f84-80cb-785dbedd6a95 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.281432 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac459-96fa-4f84-80cb-785dbedd6a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.304706 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-3a8ac459-96fa-4f84-80cb-785dbedd6a95 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:41.305949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-3a8ac459-96fa-4f84-80cb-785dbedd6a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:41.378544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d592-b3e0-4a9b-a218-8fde7aec6f42 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.387037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 59/106] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:41.388977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac459-96fa-4f84-80cb-785dbedd6a95 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.423974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.424871 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.425325 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.425821 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.426633 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:41.427090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:41.428488 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:41.445155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 48/107] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:41.445155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.454449 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:41.507979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:41.521955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac459-96fa-4f84-80cb-785dbedd6a95 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.563176 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee16304-a865-44d0-87f3-3582b018084e None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.563660 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5bb93-968f-4751-a940-4537462c2116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.564343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5bb93-968f-4751-a940-4537462c2116 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.564738 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5bb93-968f-4751-a940-4537462c2116 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.565013 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5bb93-968f-4751-a940-4537462c2116 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.578502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5bb93-968f-4751-a940-4537462c2116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-d7e5bb93-968f-4751-a940-4537462c2116 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:41.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:41.586216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:41.587077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:41.588961 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 60/108] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:41.595446 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5bb93-968f-4751-a940-4537462c2116 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.611118 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.611883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.612229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.612614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.613357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:41.613853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:41.615506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:41.627017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 49/109] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:41.627943 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.710872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:41.719810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5bb93-968f-4751-a940-4537462c2116 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.738621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397df8-e99d-47bc-8ef7-674606512a2d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.762533 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfdc09-7264-4bd8-8bc8-3ad452be17b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.763311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfdc09-7264-4bd8-8bc8-3ad452be17b8 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.763767 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfdc09-7264-4bd8-8bc8-3ad452be17b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.764122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfdc09-7264-4bd8-8bc8-3ad452be17b8 None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.765357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfdc09-7264-4bd8-8bc8-3ad452be17b8 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:41.766825 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfdc09-7264-4bd8-8bc8-3ad452be17b8 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:41.768454 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 61/110] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:41.769218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfdc09-7264-4bd8-8bc8-3ad452be17b8 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.779104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bcb06-6633-496a-84f5-b6f636966fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.779745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bcb06-6633-496a-84f5-b6f636966fe7 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.780024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bcb06-6633-496a-84f5-b6f636966fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.780325 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bcb06-6633-496a-84f5-b6f636966fe7 None admin] PATH_INFO: `/v3/users/eb436ff244d04b3cb3470051690a8e72` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.781483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bcb06-6633-496a-84f5-b6f636966fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=eb436ff244d04b3cb3470051690a8e72)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:41.782932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bcb06-6633-496a-84f5-b6f636966fe7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:41.784519 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 50/111] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/users/eb436ff244d04b3cb3470051690a8e72 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:41.785410 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bcb06-6633-496a-84f5-b6f636966fe7 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.793662 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:41.882161 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfdc09-7264-4bd8-8bc8-3ad452be17b8 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.902200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bcb06-6633-496a-84f5-b6f636966fe7 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:41.922092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa9091-eef3-4e65-bab8-84c0270533aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.922719 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9091-eef3-4e65-bab8-84c0270533aa None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.922997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9091-eef3-4e65-bab8-84c0270533aa None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.923268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa9091-eef3-4e65-bab8-84c0270533aa None admin] PATH_INFO: `/v3/users/7489ba24403840d28228fe5a47b9b63d` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.924400 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa9091-eef3-4e65-bab8-84c0270533aa None admin] RBAC: Authorizing `identity:get_user(user_id=7489ba24403840d28228fe5a47b9b63d)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:41.925879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa9091-eef3-4e65-bab8-84c0270533aa None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:41.927548 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 62/112] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/users/7489ba24403840d28228fe5a47b9b63d => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:41.928227 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa9091-eef3-4e65-bab8-84c0270533aa None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.939787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:41.940404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:41.940684 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:41.940963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:41.941674 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] RBAC: Adding query filter params (name=member) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:41.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:41.943836 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:41.952828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 51/113] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:41.953509 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:41.957259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.026409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.044816 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa9091-eef3-4e65-bab8-84c0270533aa None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.061497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f613b-2a70-4fa1-b889-76226617d437 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.080324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4afd1-f457-4e79-94fd-2c2de0313d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.080956 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4afd1-f457-4e79-94fd-2c2de0313d3d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.081239 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4afd1-f457-4e79-94fd-2c2de0313d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.081554 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4afd1-f457-4e79-94fd-2c2de0313d3d None admin] PATH_INFO: `/v3/users/d13293cad4714617b5c657c9c9a58027` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.097606 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903788e0-5367-4804-919a-1f42608fbea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.098246 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903788e0-5367-4804-919a-1f42608fbea7 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.098373 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4afd1-f457-4e79-94fd-2c2de0313d3d None admin] RBAC: Authorizing `identity:get_user(user_id=d13293cad4714617b5c657c9c9a58027)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.098526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903788e0-5367-4804-919a-1f42608fbea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.098801 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903788e0-5367-4804-919a-1f42608fbea7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.099848 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4afd1-f457-4e79-94fd-2c2de0313d3d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.099946 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903788e0-5367-4804-919a-1f42608fbea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.101341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903788e0-5367-4804-919a-1f42608fbea7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.101548 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 63/114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/users/d13293cad4714617b5c657c9c9a58027 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:42.102320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4afd1-f457-4e79-94fd-2c2de0313d3d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:42.107402 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 52/115] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:42.107402 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903788e0-5367-4804-919a-1f42608fbea7 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:42.180036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.213685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903788e0-5367-4804-919a-1f42608fbea7 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.218640 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4afd1-f457-4e79-94fd-2c2de0313d3d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.250678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2786e-6b81-407d-bd6a-da5eae51c298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.254087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2786e-6b81-407d-bd6a-da5eae51c298 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.254087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2786e-6b81-407d-bd6a-da5eae51c298 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.254087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2786e-6b81-407d-bd6a-da5eae51c298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.257349 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.257991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.258268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.258538 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.259268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] RBAC: Adding query filter params (role.id=b03c99b693c24e2c91857f8ca6255e56, scope.project.id=7ee02727048b419d8fdf7b23539e940e, user.id=7489ba24403840d28228fe5a47b9b63d) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:42.259608 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.261025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.271388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 64/116] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:34:42 2022] GET /identity/v3/role_assignments?user.id=7489ba24403840d28228fe5a47b9b63d&scope.project.id=7ee02727048b419d8fdf7b23539e940e&role.id=b03c99b693c24e2c91857f8ca6255e56 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:42.271388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:42.289347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.340105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2786e-6b81-407d-bd6a-da5eae51c298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.342019 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2786e-6b81-407d-bd6a-da5eae51c298 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.413392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1363684-7154-4881-87d1-4f5bea19d20e None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.444899 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.457323 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc72dc4-bd6f-4dff-85c5-a0781d415959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.458236 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72dc4-bd6f-4dff-85c5-a0781d415959 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.458378 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72dc4-bd6f-4dff-85c5-a0781d415959 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.458657 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72dc4-bd6f-4dff-85c5-a0781d415959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.484894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 53/117] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:34:42.485805 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2786e-6b81-407d-bd6a-da5eae51c298 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:42.550323 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc72dc4-bd6f-4dff-85c5-a0781d415959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.551810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc72dc4-bd6f-4dff-85c5-a0781d415959 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.561839 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.601694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2786e-6b81-407d-bd6a-da5eae51c298 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.642977 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883626ac-58aa-4ed8-a427-7ce386bef21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.643619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883626ac-58aa-4ed8-a427-7ce386bef21a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.643901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883626ac-58aa-4ed8-a427-7ce386bef21a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.644173 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883626ac-58aa-4ed8-a427-7ce386bef21a None admin] PATH_INFO: `/v3/users/7489ba24403840d28228fe5a47b9b63d` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.645762 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883626ac-58aa-4ed8-a427-7ce386bef21a None admin] RBAC: Authorizing `identity:get_user(user_id=7489ba24403840d28228fe5a47b9b63d)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.646874 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883626ac-58aa-4ed8-a427-7ce386bef21a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.648469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 54/118] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:42 2022] GET /identity/v3/users/7489ba24403840d28228fe5a47b9b63d => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:42.651676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883626ac-58aa-4ed8-a427-7ce386bef21a None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:42.663499 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 65/119] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:34:42.664350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc72dc4-bd6f-4dff-85c5-a0781d415959 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:42.702926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.761086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883626ac-58aa-4ed8-a427-7ce386bef21a None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.771843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc72dc4-bd6f-4dff-85c5-a0781d415959 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.780560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.797361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442641-b1c1-4cb0-ae01-745e52199c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.798188 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442641-b1c1-4cb0-ae01-745e52199c59 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.798844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442641-b1c1-4cb0-ae01-745e52199c59 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.798844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442641-b1c1-4cb0-ae01-745e52199c59 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.799748 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442641-b1c1-4cb0-ae01-745e52199c59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.801269 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442641-b1c1-4cb0-ae01-745e52199c59 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.810982 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4aad4-9275-4043-a43c-c2ea289a9d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.811634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4aad4-9275-4043-a43c-c2ea289a9d0d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.811909 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4aad4-9275-4043-a43c-c2ea289a9d0d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.812179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4aad4-9275-4043-a43c-c2ea289a9d0d None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.813312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4aad4-9275-4043-a43c-c2ea289a9d0d None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.814800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4aad4-9275-4043-a43c-c2ea289a9d0d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.816423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 66/120] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:42 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:42.818264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4aad4-9275-4043-a43c-c2ea289a9d0d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:42.831758 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 55/121] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:34:42 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:42.832562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442641-b1c1-4cb0-ae01-745e52199c59 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:42.942131 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4aad4-9275-4043-a43c-c2ea289a9d0d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:42.978809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:42.989970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e985-d3f8-43ff-8fa1-503cf180bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:42.990632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e985-d3f8-43ff-8fa1-503cf180bfaf None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:42.990900 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e985-d3f8-43ff-8fa1-503cf180bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:42.991169 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e985-d3f8-43ff-8fa1-503cf180bfaf None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:42.992412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702e985-d3f8-43ff-8fa1-503cf180bfaf None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:42.993942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702e985-d3f8-43ff-8fa1-503cf180bfaf None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:42.994840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442641-b1c1-4cb0-ae01-745e52199c59 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:43.001294 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 67/122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:42 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:43.001294 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e985-d3f8-43ff-8fa1-503cf180bfaf None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:43.041537 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b8a58-a9a7-4d87-a1c0-dbb706d2f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:43.042126 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8a58-a9a7-4d87-a1c0-dbb706d2f104 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:43.042404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8a58-a9a7-4d87-a1c0-dbb706d2f104 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:43.042669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8a58-a9a7-4d87-a1c0-dbb706d2f104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:43.057504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:43.123083 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e985-d3f8-43ff-8fa1-503cf180bfaf None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:43.132305 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b8a58-a9a7-4d87-a1c0-dbb706d2f104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:43.134524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b8a58-a9a7-4d87-a1c0-dbb706d2f104 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:43.159317 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c89b8-58ba-4a8d-8fa2-ec45836db060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:43.160262 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c89b8-58ba-4a8d-8fa2-ec45836db060 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:43.160669 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c89b8-58ba-4a8d-8fa2-ec45836db060 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:43.161082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c89b8-58ba-4a8d-8fa2-ec45836db060 None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:43.162522 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c89b8-58ba-4a8d-8fa2-ec45836db060 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:43.164293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c89b8-58ba-4a8d-8fa2-ec45836db060 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:43.172459 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 68/123] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:42 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:43.172459 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c89b8-58ba-4a8d-8fa2-ec45836db060 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:43.253638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:43.268876 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 56/124] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:34:43.268876 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b8a58-a9a7-4d87-a1c0-dbb706d2f104 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:43.287932 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c89b8-58ba-4a8d-8fa2-ec45836db060 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:43.299580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:43.329292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49c75e-9d71-44b0-9cef-70248f5805e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:43.329929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c75e-9d71-44b0-9cef-70248f5805e8 None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:43.330211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c75e-9d71-44b0-9cef-70248f5805e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:43.330484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49c75e-9d71-44b0-9cef-70248f5805e8 None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e/users/d13293cad4714617b5c657c9c9a58027/roles/0e0519c72ba44a218be35c26b72b2272` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:43.332442 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49c75e-9d71-44b0-9cef-70248f5805e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ee02727048b419d8fdf7b23539e940e, user_id=d13293cad4714617b5c657c9c9a58027, role_id=0e0519c72ba44a218be35c26b72b2272)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:43.333962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49c75e-9d71-44b0-9cef-70248f5805e8 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:43.349967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 69/125] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:43 2022] PUT /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e/users/d13293cad4714617b5c657c9c9a58027/roles/0e0519c72ba44a218be35c26b72b2272 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:34:43.351466 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49c75e-9d71-44b0-9cef-70248f5805e8 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:43.414618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b8a58-a9a7-4d87-a1c0-dbb706d2f104 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:43.460530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:43.461597 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:43.462085 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:43.462534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:43.463525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=7ee02727048b419d8fdf7b23539e940e, user.id=eb436ff244d04b3cb3470051690a8e72) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:43.464056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:43.466737 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:43.475176 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 57/126] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:34:43 2022] GET /identity/v3/role_assignments?user.id=eb436ff244d04b3cb3470051690a8e72&scope.project.id=7ee02727048b419d8fdf7b23539e940e&role.id=ebf9799815574909aa1c88e93e213c96 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:43.476585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:43.514064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49c75e-9d71-44b0-9cef-70248f5805e8 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:43.568505 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:43.569465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:43.569763 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:43.570042 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:43.571134 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] RBAC: Adding query filter params (role.id=02120488143f46a0aeda93d292f562c5, scope.project.id=7ee02727048b419d8fdf7b23539e940e, user.id=7489ba24403840d28228fe5a47b9b63d) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:43.571934 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:43.573502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:43.582606 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:43.584699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 70/127] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:34:43 2022] GET /identity/v3/role_assignments?user.id=7489ba24403840d28228fe5a47b9b63d&scope.project.id=7ee02727048b419d8fdf7b23539e940e&role.id=02120488143f46a0aeda93d292f562c5 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:43.649832 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fbc41-c39d-452f-bfb1-c2e3473f9911 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:43.695192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680765e7-58ed-4e66-a217-fa252468679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:43.696022 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680765e7-58ed-4e66-a217-fa252468679a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:43.696307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680765e7-58ed-4e66-a217-fa252468679a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:43.696583 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680765e7-58ed-4e66-a217-fa252468679a None admin] PATH_INFO: `/v3/projects/9198d863465d4b6889ea4b5b5cd18017` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:43.698338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680765e7-58ed-4e66-a217-fa252468679a None admin] RBAC: Authorizing `identity:get_project(project_id=9198d863465d4b6889ea4b5b5cd18017)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:43.700069 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680765e7-58ed-4e66-a217-fa252468679a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:43.702901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 58/128] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:43 2022] GET /identity/v3/projects/9198d863465d4b6889ea4b5b5cd18017 => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:43.709638 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:43.760165 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:43.857028 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c85553-51dd-45d4-91f9-48e0d9cf66aa None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:43.901720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62146-6917-425f-8a31-67b02e9b2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:43.902560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62146-6917-425f-8a31-67b02e9b2c16 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:43.903020 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62146-6917-425f-8a31-67b02e9b2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:43.904021 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62146-6917-425f-8a31-67b02e9b2c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:43.905250 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f62146-6917-425f-8a31-67b02e9b2c16 None admin] RBAC: Adding query filter params (role.id=b03c99b693c24e2c91857f8ca6255e56, scope.project.id=9198d863465d4b6889ea4b5b5cd18017, user.id=7489ba24403840d28228fe5a47b9b63d) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:43.905635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f62146-6917-425f-8a31-67b02e9b2c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:43.907160 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f62146-6917-425f-8a31-67b02e9b2c16 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:43.914058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 71/129] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:34:43 2022] GET /identity/v3/role_assignments?user.id=7489ba24403840d28228fe5a47b9b63d&scope.project.id=9198d863465d4b6889ea4b5b5cd18017&role.id=b03c99b693c24e2c91857f8ca6255e56 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:45.188513 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d1e96-ab80-4668-bfb2-07d2fa7ad6b6 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:45.189052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d1e96-ab80-4668-bfb2-07d2fa7ad6b6 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:45.189052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d1e96-ab80-4668-bfb2-07d2fa7ad6b6 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:45.190426 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 59/130] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:45.195813 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4093cc5-2283-4a92-b0c6-8b0939207261 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:45.196246 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4093cc5-2283-4a92-b0c6-8b0939207261 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:45.196507 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4093cc5-2283-4a92-b0c6-8b0939207261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:45.215794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-e4093cc5-2283-4a92-b0c6-8b0939207261 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:45.217018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-e4093cc5-2283-4a92-b0c6-8b0939207261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:45.292023 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 72/131] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:45.562970 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d1e96-ab80-4668-bfb2-07d2fa7ad6b6 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:45.682016 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d1e96-ab80-4668-bfb2-07d2fa7ad6b6 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:45.706726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:45.719650 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4987f6a-3906-4c4f-809f-291ecc9dc20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:45.720296 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4987f6a-3906-4c4f-809f-291ecc9dc20d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:45.720579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4987f6a-3906-4c4f-809f-291ecc9dc20d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:45.720855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4987f6a-3906-4c4f-809f-291ecc9dc20d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:45.722003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4987f6a-3906-4c4f-809f-291ecc9dc20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:45.723474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4987f6a-3906-4c4f-809f-291ecc9dc20d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:45.725068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 60/132] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:45.730886 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4093cc5-2283-4a92-b0c6-8b0939207261 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:45.747257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a7a3d-05d4-4fb6-b507-4a1c905661b3 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:45.748161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a7a3d-05d4-4fb6-b507-4a1c905661b3 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:45.748641 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a7a3d-05d4-4fb6-b507-4a1c905661b3 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:45.750027 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 61/133] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:45.755347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1327939-88cb-4975-97bb-f747dc9289e8 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:45.755623 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1327939-88cb-4975-97bb-f747dc9289e8 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:45.755900 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1327939-88cb-4975-97bb-f747dc9289e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:45.762088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:45.779558 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d1327939-88cb-4975-97bb-f747dc9289e8 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:45.780979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d1327939-88cb-4975-97bb-f747dc9289e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:45.837993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4093cc5-2283-4a92-b0c6-8b0939207261 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:45.860238 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 62/134] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:45.876440 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2747-eb74-417e-abbd-f4b66638c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:45.877048 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2747-eb74-417e-abbd-f4b66638c487 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:45.877329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2747-eb74-417e-abbd-f4b66638c487 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:45.877634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2747-eb74-417e-abbd-f4b66638c487 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:45.878284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2747-eb74-417e-abbd-f4b66638c487 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:45.879736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2747-eb74-417e-abbd-f4b66638c487 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:45.903262 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 73/135] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:34:45 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:46.132647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1327939-88cb-4975-97bb-f747dc9289e8 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:46.242894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1327939-88cb-4975-97bb-f747dc9289e8 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:46.267872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:46.281485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e6202-4d8e-478d-8efd-c43990420414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:46.282131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e6202-4d8e-478d-8efd-c43990420414 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:46.282411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e6202-4d8e-478d-8efd-c43990420414 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:46.282679 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e6202-4d8e-478d-8efd-c43990420414 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:46.293851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e6202-4d8e-478d-8efd-c43990420414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-350e6202-4d8e-478d-8efd-c43990420414 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:46.299721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:46.300589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:46.301455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 63/136] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:46.306960 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2747-eb74-417e-abbd-f4b66638c487 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:46.411043 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:46.430582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2747-eb74-417e-abbd-f4b66638c487 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:46.467994 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:46.468627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:46.468906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:46.469178 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:46.469884 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:46.470186 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:46.471577 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:46.481137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 74/137] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:46.487338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e6202-4d8e-478d-8efd-c43990420414 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:46.604546 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e6202-4d8e-478d-8efd-c43990420414 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:46.645000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35d3b-ffc6-43db-8929-ecc79ff24919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:46.645949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35d3b-ffc6-43db-8929-ecc79ff24919 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:46.646372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35d3b-ffc6-43db-8929-ecc79ff24919 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:46.646804 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35d3b-ffc6-43db-8929-ecc79ff24919 None admin] PATH_INFO: `/v3/users/d13293cad4714617b5c657c9c9a58027` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:46.648358 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35d3b-ffc6-43db-8929-ecc79ff24919 None admin] RBAC: Authorizing `identity:get_user(user_id=d13293cad4714617b5c657c9c9a58027)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:46.650049 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35d3b-ffc6-43db-8929-ecc79ff24919 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:46.651853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 64/138] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:46 2022] GET /identity/v3/users/d13293cad4714617b5c657c9c9a58027 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:46.657938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:46.770967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518090-25f5-4456-8c67-02f5824efad1 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:46.811952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78185-1fcb-4b11-89ea-e329a136912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:46.812853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78185-1fcb-4b11-89ea-e329a136912f None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:46.813283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78185-1fcb-4b11-89ea-e329a136912f None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:46.813727 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78185-1fcb-4b11-89ea-e329a136912f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:46.842906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:46.897474 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a78185-1fcb-4b11-89ea-e329a136912f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:46.899058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a78185-1fcb-4b11-89ea-e329a136912f None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:47.021076 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 75/139] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:34:47.026851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35d3b-ffc6-43db-8929-ecc79ff24919 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:47.086888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:47.141398 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35d3b-ffc6-43db-8929-ecc79ff24919 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:47.181020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43871e08-7dce-484d-8b10-58b6b9d95ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:47.182013 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43871e08-7dce-484d-8b10-58b6b9d95ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:47.182476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43871e08-7dce-484d-8b10-58b6b9d95ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:47.182927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43871e08-7dce-484d-8b10-58b6b9d95ee9 None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:47.184286 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43871e08-7dce-484d-8b10-58b6b9d95ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:47.186050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43871e08-7dce-484d-8b10-58b6b9d95ee9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:47.188024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 65/140] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:47 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:47.194338 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78185-1fcb-4b11-89ea-e329a136912f None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:47.246085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:47.304557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78185-1fcb-4b11-89ea-e329a136912f None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:47.341782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4100dba-04ae-44b2-8cde-2090e00b1239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:47.342437 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4100dba-04ae-44b2-8cde-2090e00b1239 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:47.342721 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4100dba-04ae-44b2-8cde-2090e00b1239 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:47.342991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4100dba-04ae-44b2-8cde-2090e00b1239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:47.343726 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4100dba-04ae-44b2-8cde-2090e00b1239 None admin] RBAC: Adding query filter params (role.id=0e0519c72ba44a218be35c26b72b2272, scope.project.id=7ee02727048b419d8fdf7b23539e940e, user.id=d13293cad4714617b5c657c9c9a58027) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:47.344030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4100dba-04ae-44b2-8cde-2090e00b1239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:47.345509 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4100dba-04ae-44b2-8cde-2090e00b1239 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:47.352484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 76/141] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:34:47 2022] GET /identity/v3/role_assignments?user.id=d13293cad4714617b5c657c9c9a58027&scope.project.id=7ee02727048b419d8fdf7b23539e940e&role.id=0e0519c72ba44a218be35c26b72b2272 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:48.283601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98055-36c2-4d32-a66e-249672535dd4 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:48.284122 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98055-36c2-4d32-a66e-249672535dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:48.284213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98055-36c2-4d32-a66e-249672535dd4 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:48.285657 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 66/142] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:48.291194 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b26be1-cc0a-4464-aa96-31941132757d None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:48.291480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b26be1-cc0a-4464-aa96-31941132757d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:48.291757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b26be1-cc0a-4464-aa96-31941132757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:48.310784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-52b26be1-cc0a-4464-aa96-31941132757d None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:48.311977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-52b26be1-cc0a-4464-aa96-31941132757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:48.386634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 77/143] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:48.482414 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d4014-1a86-47a0-b615-cb64b2c80017 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:48.482717 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d4014-1a86-47a0-b615-cb64b2c80017 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:48.482973 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d4014-1a86-47a0-b615-cb64b2c80017 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:48.484442 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 67/144] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:48.489529 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132a80-3cf8-49ff-a280-1ca60daccd13 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:48.489813 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132a80-3cf8-49ff-a280-1ca60daccd13 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:48.490341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85132a80-3cf8-49ff-a280-1ca60daccd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:48.502377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc239b5-ca17-447c-a092-25cf5ea0d393 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:48.502670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc239b5-ca17-447c-a092-25cf5ea0d393 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:48.502913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc239b5-ca17-447c-a092-25cf5ea0d393 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:48.504387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 68/145] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:48.509283 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb894f3-fe15-4f64-8401-3f3dd7cef928 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:48.509612 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb894f3-fe15-4f64-8401-3f3dd7cef928 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:48.509899 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb894f3-fe15-4f64-8401-3f3dd7cef928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:48.510966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-85132a80-3cf8-49ff-a280-1ca60daccd13 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:48.512262 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-85132a80-3cf8-49ff-a280-1ca60daccd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:48.528585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-3eb894f3-fe15-4f64-8401-3f3dd7cef928 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:48.529762 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-3eb894f3-fe15-4f64-8401-3f3dd7cef928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:48.550708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:48.592615 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 78/146] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:48.611229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 69/147] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:48.662261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85132a80-3cf8-49ff-a280-1ca60daccd13 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:48.766734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85132a80-3cf8-49ff-a280-1ca60daccd13 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:48.803433 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006ba3d-fdd3-4dc5-8da1-85c95843e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:48.804021 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006ba3d-fdd3-4dc5-8da1-85c95843e167 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:48.804305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006ba3d-fdd3-4dc5-8da1-85c95843e167 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:48.804577 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006ba3d-fdd3-4dc5-8da1-85c95843e167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:48.816355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006ba3d-fdd3-4dc5-8da1-85c95843e167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-8006ba3d-fdd3-4dc5-8da1-85c95843e167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:48.821407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:48.822248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:48.823142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 79/148] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:48.829535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb894f3-fe15-4f64-8401-3f3dd7cef928 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:48.880722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:48.881644 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006ba3d-fdd3-4dc5-8da1-85c95843e167 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:48.914902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:48.932892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb894f3-fe15-4f64-8401-3f3dd7cef928 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:48.968521 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:48.969142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:48.969417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:48.969715 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:48.970382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:48.970681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:48.972066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:48.982744 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 70/149] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:48.983322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:48.992984 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006ba3d-fdd3-4dc5-8da1-85c95843e167 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.030653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd965fb4-6fa3-4f77-83d4-6b3404176ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.031301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965fb4-6fa3-4f77-83d4-6b3404176ad6 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.031574 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965fb4-6fa3-4f77-83d4-6b3404176ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.031840 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965fb4-6fa3-4f77-83d4-6b3404176ad6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.033016 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd965fb4-6fa3-4f77-83d4-6b3404176ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.034555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd965fb4-6fa3-4f77-83d4-6b3404176ad6 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.036232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 80/150] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:49.037609 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd965fb4-6fa3-4f77-83d4-6b3404176ad6 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:49.092296 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0cb09-b7aa-4764-ba3c-a508eee67ea9 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.103356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:49.129006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ed42c-e9fa-4ba0-ba7f-c240f7697f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.129667 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ed42c-e9fa-4ba0-ba7f-c240f7697f25 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.129952 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ed42c-e9fa-4ba0-ba7f-c240f7697f25 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.130221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ed42c-e9fa-4ba0-ba7f-c240f7697f25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.141337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:49.142114 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ed42c-e9fa-4ba0-ba7f-c240f7697f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:49.145586 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd965fb4-6fa3-4f77-83d4-6b3404176ad6 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-c53ed42c-e9fa-4ba0-ba7f-c240f7697f25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:49.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:49.148514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:49.149362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 71/151] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:34:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:49.150054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ed42c-e9fa-4ba0-ba7f-c240f7697f25 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:49.190755 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e745-cce8-4060-85f5-f3b6ef4a151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.191391 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e745-cce8-4060-85f5-f3b6ef4a151c None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.191666 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e745-cce8-4060-85f5-f3b6ef4a151c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.191934 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e745-cce8-4060-85f5-f3b6ef4a151c None admin] PATH_INFO: `/v3/users/fc86e2b97824487d871271dd49608390` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.206745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69e745-cce8-4060-85f5-f3b6ef4a151c None admin] RBAC: Authorizing `identity:get_user(user_id=fc86e2b97824487d871271dd49608390)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.208213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69e745-cce8-4060-85f5-f3b6ef4a151c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.210222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 81/152] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:49 2022] GET /identity/v3/users/fc86e2b97824487d871271dd49608390 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:49.211000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e745-cce8-4060-85f5-f3b6ef4a151c None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:49.268211 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ed42c-e9fa-4ba0-ba7f-c240f7697f25 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.304063 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b3800-05ff-4d0f-a85e-9dbd25f13c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.304712 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b3800-05ff-4d0f-a85e-9dbd25f13c42 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.304969 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b3800-05ff-4d0f-a85e-9dbd25f13c42 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.305242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b3800-05ff-4d0f-a85e-9dbd25f13c42 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.305933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b3800-05ff-4d0f-a85e-9dbd25f13c42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.307384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b3800-05ff-4d0f-a85e-9dbd25f13c42 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.317713 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e745-cce8-4060-85f5-f3b6ef4a151c None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.330389 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 72/153] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:34:49 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:49.331550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b3800-05ff-4d0f-a85e-9dbd25f13c42 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:49.367465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:49.379927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.380719 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.380997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.381268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.381988 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:49.382289 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.383701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.392977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 82/154] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:34:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:49.398868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:49.422348 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:49.458815 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b3800-05ff-4d0f-a85e-9dbd25f13c42 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.500000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc216ce-d9cd-437e-a9ba-500304313fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.501013 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc216ce-d9cd-437e-a9ba-500304313fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.501659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc216ce-d9cd-437e-a9ba-500304313fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.501971 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc216ce-d9cd-437e-a9ba-500304313fa7 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.503157 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc216ce-d9cd-437e-a9ba-500304313fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.504613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc216ce-d9cd-437e-a9ba-500304313fa7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.506468 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 73/155] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:49 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:49.511952 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc216ce-d9cd-437e-a9ba-500304313fa7 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:49.522428 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c80f4-e3f9-4327-a1de-56fa90d84986 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.561276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f3eb-5923-4337-af7c-e57a5fbe8b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.562350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f3eb-5923-4337-af7c-e57a5fbe8b23 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.562350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f3eb-5923-4337-af7c-e57a5fbe8b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.562511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f3eb-5923-4337-af7c-e57a5fbe8b23 None admin] PATH_INFO: `/v3/users/fc86e2b97824487d871271dd49608390` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.563623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1f3eb-5923-4337-af7c-e57a5fbe8b23 None admin] RBAC: Authorizing `identity:get_user(user_id=fc86e2b97824487d871271dd49608390)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.565151 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1f3eb-5923-4337-af7c-e57a5fbe8b23 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.566890 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 83/156] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:49 2022] GET /identity/v3/users/fc86e2b97824487d871271dd49608390 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:49.572182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f3eb-5923-4337-af7c-e57a5fbe8b23 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:49.641584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:49.650898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc216ce-d9cd-437e-a9ba-500304313fa7 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.693071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:49.699164 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29178511-bd80-44fb-b8d6-c10f20e3f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.700093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29178511-bd80-44fb-b8d6-c10f20e3f754 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.700242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29178511-bd80-44fb-b8d6-c10f20e3f754 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.701028 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29178511-bd80-44fb-b8d6-c10f20e3f754 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb/users/fc86e2b97824487d871271dd49608390/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.706084 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29178511-bd80-44fb-b8d6-c10f20e3f754 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f782cc6f7948768294e7961e8c66fb, user_id=fc86e2b97824487d871271dd49608390, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.706084 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29178511-bd80-44fb-b8d6-c10f20e3f754 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.715100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f3eb-5923-4337-af7c-e57a5fbe8b23 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.725503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 74/157] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:49 2022] PUT /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb/users/fc86e2b97824487d871271dd49608390/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:34:49.768358 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb17e1-72d4-4604-8112-28c530f9eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.769009 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb17e1-72d4-4604-8112-28c530f9eb42 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.769287 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb17e1-72d4-4604-8112-28c530f9eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.769588 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb17e1-72d4-4604-8112-28c530f9eb42 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.770767 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb17e1-72d4-4604-8112-28c530f9eb42 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.772312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb17e1-72d4-4604-8112-28c530f9eb42 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.774409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 84/158] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:49 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:49.780918 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29178511-bd80-44fb-b8d6-c10f20e3f754 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:49.902968 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29178511-bd80-44fb-b8d6-c10f20e3f754 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:49.942428 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca08e6-ec3f-4118-9cb0-0dadb65e0680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:49.943094 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca08e6-ec3f-4118-9cb0-0dadb65e0680 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:49.943371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca08e6-ec3f-4118-9cb0-0dadb65e0680 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:49.943643 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca08e6-ec3f-4118-9cb0-0dadb65e0680 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb/users/fc86e2b97824487d871271dd49608390/roles/02120488143f46a0aeda93d292f562c5` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:49.947654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca08e6-ec3f-4118-9cb0-0dadb65e0680 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f782cc6f7948768294e7961e8c66fb, user_id=fc86e2b97824487d871271dd49608390, role_id=02120488143f46a0aeda93d292f562c5)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:49.947654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca08e6-ec3f-4118-9cb0-0dadb65e0680 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:49.963486 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 75/159] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:49 2022] PUT /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb/users/fc86e2b97824487d871271dd49608390/roles/02120488143f46a0aeda93d292f562c5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:34:51.776696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655cfe2-69d3-4962-b162-ecedbc6a9a2c None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:51.777235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655cfe2-69d3-4962-b162-ecedbc6a9a2c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:51.777235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655cfe2-69d3-4962-b162-ecedbc6a9a2c None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:51.778891 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 85/160] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:51.784463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f888f2-12e7-4682-921d-a18f9bc3fee1 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:51.784952 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f888f2-12e7-4682-921d-a18f9bc3fee1 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:51.785035 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f888f2-12e7-4682-921d-a18f9bc3fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:51.793301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1302f2-9805-46d6-a6f6-70e9c3f4eb83 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:51.793631 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1302f2-9805-46d6-a6f6-70e9c3f4eb83 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:51.794424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1302f2-9805-46d6-a6f6-70e9c3f4eb83 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:51.795933 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 86/161] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:51.801134 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db209f9e-9457-479b-bc9d-2a5457e4fa07 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:51.801416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db209f9e-9457-479b-bc9d-2a5457e4fa07 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:51.801726 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db209f9e-9457-479b-bc9d-2a5457e4fa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:51.806949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-51f888f2-12e7-4682-921d-a18f9bc3fee1 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:51.808371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-51f888f2-12e7-4682-921d-a18f9bc3fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:51.819298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:51.820483 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-db209f9e-9457-479b-bc9d-2a5457e4fa07 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:51.821869 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-db209f9e-9457-479b-bc9d-2a5457e4fa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:51.886315 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 76/162] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:51.900179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 87/163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:52.037953 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad693db-ecd7-4ae6-9cb2-3c6719f9af43 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.038613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad693db-ecd7-4ae6-9cb2-3c6719f9af43 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.039081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad693db-ecd7-4ae6-9cb2-3c6719f9af43 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.040623 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 77/164] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:52.046424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb2cb-22de-43d8-be44-76956279b486 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.046935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb2cb-22de-43d8-be44-76956279b486 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.047369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb2cb-22de-43d8-be44-76956279b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.067502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-d6acb2cb-22de-43d8-be44-76956279b486 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:52.068970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-d6acb2cb-22de-43d8-be44-76956279b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:52.151045 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 88/165] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:52.171922 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad693db-ecd7-4ae6-9cb2-3c6719f9af43 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.189782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acb2cb-22de-43d8-be44-76956279b486 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.207865 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:52.291693 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad693db-ecd7-4ae6-9cb2-3c6719f9af43 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:52.303019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acb2cb-22de-43d8-be44-76956279b486 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:52.331326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629322e-c92d-4e71-965a-2a470c3e0a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:52.332293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629322e-c92d-4e71-965a-2a470c3e0a21 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.332710 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629322e-c92d-4e71-965a-2a470c3e0a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.333124 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629322e-c92d-4e71-965a-2a470c3e0a21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.339361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d246b9-c5d3-4a73-a22b-0a7029972263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:52.340002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d246b9-c5d3-4a73-a22b-0a7029972263 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.340279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d246b9-c5d3-4a73-a22b-0a7029972263 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.340547 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d246b9-c5d3-4a73-a22b-0a7029972263 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.341730 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d246b9-c5d3-4a73-a22b-0a7029972263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:52.343198 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d246b9-c5d3-4a73-a22b-0a7029972263 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:52.345006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 89/166] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:52.345966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d449c7-b1f2-48e4-9994-5dd7407cc238 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.346251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d449c7-b1f2-48e4-9994-5dd7407cc238 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.346518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d449c7-b1f2-48e4-9994-5dd7407cc238 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.347866 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 90/167] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:52.349425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629322e-c92d-4e71-965a-2a470c3e0a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:52.352468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d449c7-b1f2-48e4-9994-5dd7407cc238 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-4629322e-c92d-4e71-965a-2a470c3e0a21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:52.354703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:52.355550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:52.357263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 78/168] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:52.358334 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1307-f9ee-4747-b96d-3737c94da18a None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.358334 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1307-f9ee-4747-b96d-3737c94da18a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.358334 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1307-f9ee-4747-b96d-3737c94da18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.366340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:52.378083 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-351c1307-f9ee-4747-b96d-3737c94da18a None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:52.379282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-351c1307-f9ee-4747-b96d-3737c94da18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:52.447760 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:52.451881 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 79/169] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:52.452747 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c1307-f9ee-4747-b96d-3737c94da18a None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.474142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d449c7-b1f2-48e4-9994-5dd7407cc238 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:52.513920 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c09fe-8219-4857-82d3-5ee02b9ba46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:52.514801 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09fe-8219-4857-82d3-5ee02b9ba46c None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.515217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09fe-8219-4857-82d3-5ee02b9ba46c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.515632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09fe-8219-4857-82d3-5ee02b9ba46c None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.516283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c09fe-8219-4857-82d3-5ee02b9ba46c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:52.517733 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c09fe-8219-4857-82d3-5ee02b9ba46c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:52.549561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 91/170] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:34:52 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:34:52.549561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c09fe-8219-4857-82d3-5ee02b9ba46c None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.604360 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c1307-f9ee-4747-b96d-3737c94da18a None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:52.654207 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:52.655065 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.655442 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.655809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.656903 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] RBAC: Adding query filter params (name=member) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:52.657817 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:52.659279 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:52.660926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:52.673287 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c09fe-8219-4857-82d3-5ee02b9ba46c None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:52.677160 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 80/171] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:52.682721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.719612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc467e-472a-4029-9021-ffc7402727ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:52.720680 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc467e-472a-4029-9021-ffc7402727ce None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.720993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc467e-472a-4029-9021-ffc7402727ce None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.721268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc467e-472a-4029-9021-ffc7402727ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.733132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:52.739073 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc467e-472a-4029-9021-ffc7402727ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-7bfc467e-472a-4029-9021-ffc7402727ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:52.746486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:52.747622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:34:52.748397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:52.751352 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 92/172] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:34:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:52.753558 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc467e-472a-4029-9021-ffc7402727ce None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.821677 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58575b47-3020-42e5-9c8a-789247955391 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:52.861107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c7d0-06f3-4b11-b195-15a1b4caacc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:52.861786 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c7d0-06f3-4b11-b195-15a1b4caacc4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.862062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c7d0-06f3-4b11-b195-15a1b4caacc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.862333 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c7d0-06f3-4b11-b195-15a1b4caacc4 None admin] PATH_INFO: `/v3/users/84e49500f26d4d8ba277a104f2145352` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.874549 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc467e-472a-4029-9021-ffc7402727ce None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:52.882943 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279c7d0-06f3-4b11-b195-15a1b4caacc4 None admin] RBAC: Authorizing `identity:get_user(user_id=84e49500f26d4d8ba277a104f2145352)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:52.884473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279c7d0-06f3-4b11-b195-15a1b4caacc4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:52.886379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 81/173] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:52 2022] GET /identity/v3/users/84e49500f26d4d8ba277a104f2145352 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:52.886948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c7d0-06f3-4b11-b195-15a1b4caacc4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.920544 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81a90a-c5d4-4b2d-862e-07c3cff12b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:52.921193 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a90a-c5d4-4b2d-862e-07c3cff12b4e None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:52.921500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a90a-c5d4-4b2d-862e-07c3cff12b4e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:52.921778 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a90a-c5d4-4b2d-862e-07c3cff12b4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:52.939822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81a90a-c5d4-4b2d-862e-07c3cff12b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-ac81a90a-c5d4-4b2d-862e-07c3cff12b4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:52.945612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:52.946757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 93/174] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:34:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:52.947754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81a90a-c5d4-4b2d-862e-07c3cff12b4e None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:52.969293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:53.022014 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:53.026529 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c7d0-06f3-4b11-b195-15a1b4caacc4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:53.065909 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:53.066508 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.066784 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.067051 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.067714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:53.068010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:53.069888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:53.072600 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81a90a-c5d4-4b2d-862e-07c3cff12b4e None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:53.080037 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 82/175] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:53.080832 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:53.112709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e2dd-96d9-4c2f-b9e0-933322d13c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:53.113791 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e2dd-96d9-4c2f-b9e0-933322d13c17 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.114369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e2dd-96d9-4c2f-b9e0-933322d13c17 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.114842 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9e2dd-96d9-4c2f-b9e0-933322d13c17 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.116483 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9e2dd-96d9-4c2f-b9e0-933322d13c17 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:53.118206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9e2dd-96d9-4c2f-b9e0-933322d13c17 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:53.121538 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 94/176] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:52 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:53.127059 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e2dd-96d9-4c2f-b9e0-933322d13c17 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:53.199547 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727194d1-6d0a-43bc-9c27-7713eadb1015 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:53.220179 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:53.243944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:53.245383 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.246172 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.246691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.247693 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:53.248597 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:53.250263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:53.255186 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9e2dd-96d9-4c2f-b9e0-933322d13c17 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:53.261544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 83/177] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:34:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:53.262372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:53.295331 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:53.307493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14b48e-1510-4312-ae1b-39f528601319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:53.308138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14b48e-1510-4312-ae1b-39f528601319 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.308411 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14b48e-1510-4312-ae1b-39f528601319 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.308673 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14b48e-1510-4312-ae1b-39f528601319 None admin] PATH_INFO: `/v3/users/fc86e2b97824487d871271dd49608390` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.310633 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14b48e-1510-4312-ae1b-39f528601319 None admin] RBAC: Authorizing `identity:get_user(user_id=fc86e2b97824487d871271dd49608390)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:53.313033 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14b48e-1510-4312-ae1b-39f528601319 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:53.314857 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 95/178] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:53 2022] GET /identity/v3/users/fc86e2b97824487d871271dd49608390 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:53.315457 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14b48e-1510-4312-ae1b-39f528601319 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:53.390891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986c296-f42a-45ee-b546-be4a1e96983e None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:53.435270 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fce33-6bcd-47cc-ac89-7d743ed29035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:53.436197 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fce33-6bcd-47cc-ac89-7d743ed29035 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.436624 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fce33-6bcd-47cc-ac89-7d743ed29035 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.437573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fce33-6bcd-47cc-ac89-7d743ed29035 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb/users/84e49500f26d4d8ba277a104f2145352/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.440107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fce33-6bcd-47cc-ac89-7d743ed29035 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f782cc6f7948768294e7961e8c66fb, user_id=84e49500f26d4d8ba277a104f2145352, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:53.441772 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fce33-6bcd-47cc-ac89-7d743ed29035 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:53.452324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14b48e-1510-4312-ae1b-39f528601319 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:53.459667 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 84/179] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:53 2022] PUT /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb/users/84e49500f26d4d8ba277a104f2145352/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:34:53.461363 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fce33-6bcd-47cc-ac89-7d743ed29035 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:53.493492 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc013-49fc-4365-98b6-b7b7453b1e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:53.494164 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc013-49fc-4365-98b6-b7b7453b1e1a None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.494432 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc013-49fc-4365-98b6-b7b7453b1e1a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.494696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc013-49fc-4365-98b6-b7b7453b1e1a None admin] PATH_INFO: `/v3/users/fc86e2b97824487d871271dd49608390` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.495977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefc013-49fc-4365-98b6-b7b7453b1e1a None admin] RBAC: Authorizing `identity:get_user(user_id=fc86e2b97824487d871271dd49608390)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:53.498126 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefc013-49fc-4365-98b6-b7b7453b1e1a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:53.500473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 96/180] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:53 2022] GET /identity/v3/users/fc86e2b97824487d871271dd49608390 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:53.507793 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc013-49fc-4365-98b6-b7b7453b1e1a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:53.554566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:53.633112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:53.682980 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc013-49fc-4365-98b6-b7b7453b1e1a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:53.701144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fce33-6bcd-47cc-ac89-7d743ed29035 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:53.736685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ee381-66cf-4170-931f-70177f26b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:53.737310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ee381-66cf-4170-931f-70177f26b143 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.737613 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ee381-66cf-4170-931f-70177f26b143 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.737886 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ee381-66cf-4170-931f-70177f26b143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.758477 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305db80-96d0-4ed8-bbf0-d33314688325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:53.759377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305db80-96d0-4ed8-bbf0-d33314688325 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.759654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305db80-96d0-4ed8-bbf0-d33314688325 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.759926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305db80-96d0-4ed8-bbf0-d33314688325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.841801 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ee381-66cf-4170-931f-70177f26b143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:53.843292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ee381-66cf-4170-931f-70177f26b143 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:53.877360 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305db80-96d0-4ed8-bbf0-d33314688325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:53.878878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305db80-96d0-4ed8-bbf0-d33314688325 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:53.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:53.952582 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:54.023288 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 97/181] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:34:54.034507 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ee381-66cf-4170-931f-70177f26b143 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:54.058049 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 85/182] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:34:54.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305db80-96d0-4ed8-bbf0-d33314688325 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:54.211593 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ee381-66cf-4170-931f-70177f26b143 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:54.259549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305db80-96d0-4ed8-bbf0-d33314688325 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:54.284905 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0069b-d922-40db-90c8-bd885ea4feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:54.285573 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0069b-d922-40db-90c8-bd885ea4feaf None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:54.285930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0069b-d922-40db-90c8-bd885ea4feaf None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:54.286201 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0069b-d922-40db-90c8-bd885ea4feaf None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:54.287358 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0069b-d922-40db-90c8-bd885ea4feaf None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:54.288880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0069b-d922-40db-90c8-bd885ea4feaf None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:54.290774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 98/183] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:54 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:54.296785 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0069b-d922-40db-90c8-bd885ea4feaf None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:54.330355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd488fd-7b13-46a5-8a27-63a8f1e57a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:54.331274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd488fd-7b13-46a5-8a27-63a8f1e57a78 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:54.331647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd488fd-7b13-46a5-8a27-63a8f1e57a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:54.332016 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd488fd-7b13-46a5-8a27-63a8f1e57a78 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:54.333426 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd488fd-7b13-46a5-8a27-63a8f1e57a78 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:54.335009 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd488fd-7b13-46a5-8a27-63a8f1e57a78 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:54.337313 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 86/184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:54 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:54.344446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd488fd-7b13-46a5-8a27-63a8f1e57a78 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:54.346242 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:54.354951 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:54.484270 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd488fd-7b13-46a5-8a27-63a8f1e57a78 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:54.501358 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0069b-d922-40db-90c8-bd885ea4feaf None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:54.555826 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d633b-ee2a-4c20-826c-952fb7bad367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:54.556447 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d633b-ee2a-4c20-826c-952fb7bad367 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:54.556719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d633b-ee2a-4c20-826c-952fb7bad367 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:54.556986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d633b-ee2a-4c20-826c-952fb7bad367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:54.557739 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d633b-ee2a-4c20-826c-952fb7bad367 None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=d5f782cc6f7948768294e7961e8c66fb, user.id=fc86e2b97824487d871271dd49608390) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:54.558043 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d633b-ee2a-4c20-826c-952fb7bad367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:54.559485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d633b-ee2a-4c20-826c-952fb7bad367 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:54.573528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 87/185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:34:54 2022] GET /identity/v3/role_assignments?user.id=fc86e2b97824487d871271dd49608390&scope.project.id=d5f782cc6f7948768294e7961e8c66fb&role.id=ebf9799815574909aa1c88e93e213c96 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:54.574253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37e32b-e379-4bdd-84cf-7a18d4765e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:54.574939 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37e32b-e379-4bdd-84cf-7a18d4765e58 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:54.575736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37e32b-e379-4bdd-84cf-7a18d4765e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:54.576074 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37e32b-e379-4bdd-84cf-7a18d4765e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:54.577033 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37e32b-e379-4bdd-84cf-7a18d4765e58 None admin] RBAC: Adding query filter params (role.id=02120488143f46a0aeda93d292f562c5, scope.project.id=d5f782cc6f7948768294e7961e8c66fb, user.id=fc86e2b97824487d871271dd49608390) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:54.577343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37e32b-e379-4bdd-84cf-7a18d4765e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:54.578958 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37e32b-e379-4bdd-84cf-7a18d4765e58 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:54.586528 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 99/186] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:34:54 2022] GET /identity/v3/role_assignments?user.id=fc86e2b97824487d871271dd49608390&scope.project.id=d5f782cc6f7948768294e7961e8c66fb&role.id=02120488143f46a0aeda93d292f562c5 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:55.188402 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcb8e9-5d8a-45dc-9b55-24c56b902ed9 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:55.188938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcb8e9-5d8a-45dc-9b55-24c56b902ed9 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:55.188938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcb8e9-5d8a-45dc-9b55-24c56b902ed9 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:55.190344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 88/187] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:55.195561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a140-6466-4ef9-8986-9662acb4a5e3 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:55.195966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a140-6466-4ef9-8986-9662acb4a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:55.196127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a140-6466-4ef9-8986-9662acb4a5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:55.210560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9f9f-78cb-42e9-8f21-a97c2152ae3f None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:55.210890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9f9f-78cb-42e9-8f21-a97c2152ae3f None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:55.211102 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9f9f-78cb-42e9-8f21-a97c2152ae3f None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:55.212431 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 89/188] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:55.215547 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-0be8a140-6466-4ef9-8986-9662acb4a5e3 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:55.216851 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-0be8a140-6466-4ef9-8986-9662acb4a5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:55.218298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebd53f-a9e0-490e-9207-f5ee89bf8851 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:55.218577 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebd53f-a9e0-490e-9207-f5ee89bf8851 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:55.218853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebd53f-a9e0-490e-9207-f5ee89bf8851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:55.237126 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-21ebd53f-a9e0-490e-9207-f5ee89bf8851 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:55.238241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-21ebd53f-a9e0-490e-9207-f5ee89bf8851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:55.297482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 100/189] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:55.311415 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:55.321734 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 90/190] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:55.566179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a140-6466-4ef9-8986-9662acb4a5e3 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:55.586604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebd53f-a9e0-490e-9207-f5ee89bf8851 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:55.592416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:55.676166 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a140-6466-4ef9-8986-9662acb4a5e3 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:55.692584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebd53f-a9e0-490e-9207-f5ee89bf8851 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:55.711332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c99997-e0a4-4302-8c9d-775b1c724758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:55.711969 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c99997-e0a4-4302-8c9d-775b1c724758 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:55.712243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c99997-e0a4-4302-8c9d-775b1c724758 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:55.712510 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c99997-e0a4-4302-8c9d-775b1c724758 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:55.725262 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c99997-e0a4-4302-8c9d-775b1c724758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:55.728134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc21960-6552-4cf2-badb-118c248b0bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:55.728772 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc21960-6552-4cf2-badb-118c248b0bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:55.729050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc21960-6552-4cf2-badb-118c248b0bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:55.729322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc21960-6552-4cf2-badb-118c248b0bc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-00c99997-e0a4-4302-8c9d-775b1c724758 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:55.730243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:55.731132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:34:55.734278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:55.734875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc21960-6552-4cf2-badb-118c248b0bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:55.734950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 101/191] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:55.735015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc21960-6552-4cf2-badb-118c248b0bc1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:55.735015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 91/192] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:55.738399 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c99997-e0a4-4302-8c9d-775b1c724758 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:55.747517 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc21960-6552-4cf2-badb-118c248b0bc1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:55.820247 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:55.838691 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:55.858246 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c99997-e0a4-4302-8c9d-775b1c724758 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:55.862716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc21960-6552-4cf2-badb-118c248b0bc1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:55.902047 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:55.902729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:55.903003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:55.903264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:55.904463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:55.904764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:55.906168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:55.907174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a718db-c29c-4093-b9d4-c14bbfa3f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:55.907800 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a718db-c29c-4093-b9d4-c14bbfa3f3c9 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:55.908078 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a718db-c29c-4093-b9d4-c14bbfa3f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:55.908387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a718db-c29c-4093-b9d4-c14bbfa3f3c9 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:55.909099 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a718db-c29c-4093-b9d4-c14bbfa3f3c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:55.910577 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a718db-c29c-4093-b9d4-c14bbfa3f3c9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:55.921257 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 102/193] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:55.926912 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:55.933892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 92/194] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:34:55 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:34:56.062959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374744d-5826-4af0-8472-9dd504c3be11 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:56.091384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192b6b-4595-47f4-aac7-5409fa1937bf None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:56.091384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192b6b-4595-47f4-aac7-5409fa1937bf None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:56.091384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192b6b-4595-47f4-aac7-5409fa1937bf None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:56.091384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 93/195] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:56.097835 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f97f2-2698-4375-b193-f3bfb4c65d14 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:56.098113 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f97f2-2698-4375-b193-f3bfb4c65d14 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:56.098384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f97f2-2698-4375-b193-f3bfb4c65d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:56.113259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d80f-439f-4d70-aa3a-bc573483a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:56.114214 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d80f-439f-4d70-aa3a-bc573483a3d0 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:56.114665 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d80f-439f-4d70-aa3a-bc573483a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:56.115081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345d80f-439f-4d70-aa3a-bc573483a3d0 None admin] PATH_INFO: `/v3/users/3031da18bbb54645bc6aefa83ca0e533` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:56.130023 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-e55f97f2-2698-4375-b193-f3bfb4c65d14 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:56.131910 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e55f97f2-2698-4375-b193-f3bfb4c65d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:56.133853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345d80f-439f-4d70-aa3a-bc573483a3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=3031da18bbb54645bc6aefa83ca0e533)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:56.135454 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345d80f-439f-4d70-aa3a-bc573483a3d0 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:56.137379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 103/196] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:55 2022] GET /identity/v3/users/3031da18bbb54645bc6aefa83ca0e533 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:56.143794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d80f-439f-4d70-aa3a-bc573483a3d0 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:56.149420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:56.223796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 94/197] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:56.296752 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345d80f-439f-4d70-aa3a-bc573483a3d0 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:56.348031 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2a01-a8fa-4f01-86eb-4b107e6a9d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:56.348596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2a01-a8fa-4f01-86eb-4b107e6a9d9b None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:56.348874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2a01-a8fa-4f01-86eb-4b107e6a9d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:56.349145 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2a01-a8fa-4f01-86eb-4b107e6a9d9b None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:56.350377 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb2a01-a8fa-4f01-86eb-4b107e6a9d9b None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:56.351842 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb2a01-a8fa-4f01-86eb-4b107e6a9d9b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:56.353579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 104/198] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:56 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:56.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f97f2-2698-4375-b193-f3bfb4c65d14 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:56.435450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:56.495812 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f97f2-2698-4375-b193-f3bfb4c65d14 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:56.522455 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2a01-a8fa-4f01-86eb-4b107e6a9d9b None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:56.542384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e2202-30b8-472b-a557-0a9fe2f79c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:56.543325 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e2202-30b8-472b-a557-0a9fe2f79c34 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:56.545126 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e2202-30b8-472b-a557-0a9fe2f79c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:56.545597 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e2202-30b8-472b-a557-0a9fe2f79c34 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb/users/3031da18bbb54645bc6aefa83ca0e533/roles/0e0519c72ba44a218be35c26b72b2272` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:56.547974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e2202-30b8-472b-a557-0a9fe2f79c34 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5f782cc6f7948768294e7961e8c66fb, user_id=3031da18bbb54645bc6aefa83ca0e533, role_id=0e0519c72ba44a218be35c26b72b2272)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:56.549700 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e2202-30b8-472b-a557-0a9fe2f79c34 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:56.570279 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 95/199] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:34:56 2022] PUT /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb/users/3031da18bbb54645bc6aefa83ca0e533/roles/0e0519c72ba44a218be35c26b72b2272 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:34:56.636442 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:56.681024 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb2a01-a8fa-4f01-86eb-4b107e6a9d9b None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:56.727088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f4de3-a3eb-4e35-9ec7-a3704e662b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:56.728004 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f4de3-a3eb-4e35-9ec7-a3704e662b45 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:56.728449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f4de3-a3eb-4e35-9ec7-a3704e662b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:56.728862 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f4de3-a3eb-4e35-9ec7-a3704e662b45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:56.743835 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f4de3-a3eb-4e35-9ec7-a3704e662b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-4c6f4de3-a3eb-4e35-9ec7-a3704e662b45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:56.750938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:56.752081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:56.753055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:56.755555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 105/200] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:34:56.762894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e2202-30b8-472b-a557-0a9fe2f79c34 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:56.887503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e2202-30b8-472b-a557-0a9fe2f79c34 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:56.905882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:56.929368 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:56.930091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:56.930941 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:56.931215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:56.931952 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] RBAC: Adding query filter params (name=member) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:56.932249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:56.934265 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:56.945106 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 96/201] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:56.952364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f4de3-a3eb-4e35-9ec7-a3704e662b45 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:57.077866 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f4de3-a3eb-4e35-9ec7-a3704e662b45 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:57.117009 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:57.123010 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be6dbe-446c-4319-86be-8737ec417587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:57.123749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6dbe-446c-4319-86be-8737ec417587 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:57.124239 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6dbe-446c-4319-86be-8737ec417587 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:57.124678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6dbe-446c-4319-86be-8737ec417587 None admin] PATH_INFO: `/v3/users/84e49500f26d4d8ba277a104f2145352` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:57.125967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be6dbe-446c-4319-86be-8737ec417587 None admin] RBAC: Authorizing `identity:get_user(user_id=84e49500f26d4d8ba277a104f2145352)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:57.127518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be6dbe-446c-4319-86be-8737ec417587 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:57.129369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 106/202] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:56 2022] GET /identity/v3/users/84e49500f26d4d8ba277a104f2145352 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:57.135464 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:57.261474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8c6e-bdb3-4e3d-991a-3d826585a6fe None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:57.306161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ef1f-7442-4a36-8af9-159eb97e6248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:57.306788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ef1f-7442-4a36-8af9-159eb97e6248 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:57.307062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ef1f-7442-4a36-8af9-159eb97e6248 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:57.307328 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ef1f-7442-4a36-8af9-159eb97e6248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:57.369972 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:57.395274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6ef1f-7442-4a36-8af9-159eb97e6248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:57.396731 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6ef1f-7442-4a36-8af9-159eb97e6248 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:57.505091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 97/203] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:34:57.510794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be6dbe-446c-4319-86be-8737ec417587 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:57.622758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be6dbe-446c-4319-86be-8737ec417587 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:57.666536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54312b-9f98-49f1-b9aa-46b525eaefa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:57.667177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54312b-9f98-49f1-b9aa-46b525eaefa0 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:57.667457 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54312b-9f98-49f1-b9aa-46b525eaefa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:57.667727 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54312b-9f98-49f1-b9aa-46b525eaefa0 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:57.668860 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54312b-9f98-49f1-b9aa-46b525eaefa0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:57.671001 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54312b-9f98-49f1-b9aa-46b525eaefa0 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:57.673033 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 107/204] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:34:57 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:57.678490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ef1f-7442-4a36-8af9-159eb97e6248 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:57.760117 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:57.794811 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ef1f-7442-4a36-8af9-159eb97e6248 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:57.831226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680b41a-ef33-4997-832a-a8b32caf364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:57.831836 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680b41a-ef33-4997-832a-a8b32caf364b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:57.832107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680b41a-ef33-4997-832a-a8b32caf364b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:57.832374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680b41a-ef33-4997-832a-a8b32caf364b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:57.833103 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680b41a-ef33-4997-832a-a8b32caf364b None admin] RBAC: Adding query filter params (role.id=b03c99b693c24e2c91857f8ca6255e56, scope.project.id=d5f782cc6f7948768294e7961e8c66fb, user.id=84e49500f26d4d8ba277a104f2145352) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:57.833407 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680b41a-ef33-4997-832a-a8b32caf364b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:57.834871 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680b41a-ef33-4997-832a-a8b32caf364b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:57.841367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 98/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:34:57 2022] GET /identity/v3/role_assignments?user.id=84e49500f26d4d8ba277a104f2145352&scope.project.id=d5f782cc6f7948768294e7961e8c66fb&role.id=b03c99b693c24e2c91857f8ca6255e56 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:58.423521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bc863-4e31-4bbc-a446-1a300c9c2349 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:58.423793 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bc863-4e31-4bbc-a446-1a300c9c2349 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:58.424237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bc863-4e31-4bbc-a446-1a300c9c2349 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:58.425769 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 108/206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:58.431032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57907-e65a-4f0f-8b7a-a754d275037f None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:58.431510 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57907-e65a-4f0f-8b7a-a754d275037f None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:58.431585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57907-e65a-4f0f-8b7a-a754d275037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:58.450031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-c3a57907-e65a-4f0f-8b7a-a754d275037f None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:58.451741 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-c3a57907-e65a-4f0f-8b7a-a754d275037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:58.507743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a999-0b0d-4e6f-a1ca-728173774977 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:58.508027 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a999-0b0d-4e6f-a1ca-728173774977 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:58.508473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a999-0b0d-4e6f-a1ca-728173774977 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:58.509851 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 109/207] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:34:58.515816 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89f0-93ce-4cd8-8451-5b5a06ed1d94 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:58.516425 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89f0-93ce-4cd8-8451-5b5a06ed1d94 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:58.516425 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb89f0-93ce-4cd8-8451-5b5a06ed1d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:58.525301 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 99/208] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:58.534612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-6fbb89f0-93ce-4cd8-8451-5b5a06ed1d94 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:58.535785 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6fbb89f0-93ce-4cd8-8451-5b5a06ed1d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:58.599180 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:58.605673 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 110/209] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:34:58.807558 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a57907-e65a-4f0f-8b7a-a754d275037f None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:58.877238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb89f0-93ce-4cd8-8451-5b5a06ed1d94 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:58.882449 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:58.922117 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a57907-e65a-4f0f-8b7a-a754d275037f None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:58.958301 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c687dc-f7cc-476e-a8e9-79233566948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:58.958940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c687dc-f7cc-476e-a8e9-79233566948d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:58.959219 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c687dc-f7cc-476e-a8e9-79233566948d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:58.959487 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c687dc-f7cc-476e-a8e9-79233566948d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:58.975599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c687dc-f7cc-476e-a8e9-79233566948d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-33c687dc-f7cc-476e-a8e9-79233566948d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:58.980133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:58.982294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:34:58.984110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 100/210] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:58.987923 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c687dc-f7cc-476e-a8e9-79233566948d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:59.005201 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb89f0-93ce-4cd8-8451-5b5a06ed1d94 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:59.042090 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e309d-a4ea-4ab4-961f-a7ec94fd0e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:59.042723 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e309d-a4ea-4ab4-961f-a7ec94fd0e34 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.042994 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e309d-a4ea-4ab4-961f-a7ec94fd0e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.043261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e309d-a4ea-4ab4-961f-a7ec94fd0e34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.045620 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e309d-a4ea-4ab4-961f-a7ec94fd0e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:59.047058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e309d-a4ea-4ab4-961f-a7ec94fd0e34 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:59.048628 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 111/211] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:34:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:59.049787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fea2c-6c80-4e24-a02f-b2abaf0062bf None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.050061 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fea2c-6c80-4e24-a02f-b2abaf0062bf None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.050330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fea2c-6c80-4e24-a02f-b2abaf0062bf None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.051547 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 112/212] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:34:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:34:59.054626 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fea2c-6c80-4e24-a02f-b2abaf0062bf None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:59.095880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c687dc-f7cc-476e-a8e9-79233566948d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:59.122972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:59.125573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:59.131213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8842004-1bea-46ab-bb71-7c2e1ee91b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:59.131816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8842004-1bea-46ab-bb71-7c2e1ee91b8d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.132088 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8842004-1bea-46ab-bb71-7c2e1ee91b8d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.132352 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8842004-1bea-46ab-bb71-7c2e1ee91b8d None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.133010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8842004-1bea-46ab-bb71-7c2e1ee91b8d None admin] RBAC: Adding query filter params (name=member) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:59.133305 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8842004-1bea-46ab-bb71-7c2e1ee91b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:59.134708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8842004-1bea-46ab-bb71-7c2e1ee91b8d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:59.143925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 101/213] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:34:59.146862 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509627-a0cf-4e11-97b3-ace9f39e06e8 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.147153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509627-a0cf-4e11-97b3-ace9f39e06e8 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.147891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c509627-a0cf-4e11-97b3-ace9f39e06e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.161081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fea2c-6c80-4e24-a02f-b2abaf0062bf None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:59.165977 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-8c509627-a0cf-4e11-97b3-ace9f39e06e8 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:34:59.167159 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-8c509627-a0cf-4e11-97b3-ace9f39e06e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:34:59.195718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392a957-47e4-45f6-b9eb-be7b9cef8a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:59.196326 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392a957-47e4-45f6-b9eb-be7b9cef8a1a None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.196587 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392a957-47e4-45f6-b9eb-be7b9cef8a1a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.196860 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392a957-47e4-45f6-b9eb-be7b9cef8a1a None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.197514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392a957-47e4-45f6-b9eb-be7b9cef8a1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:59.198945 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392a957-47e4-45f6-b9eb-be7b9cef8a1a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:59.221069 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 113/214] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:34:59 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:34:59.221919 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392a957-47e4-45f6-b9eb-be7b9cef8a1a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:59.240861 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 102/215] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:34:59.353301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392a957-47e4-45f6-b9eb-be7b9cef8a1a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:59.380483 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:59.396902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84ecb3-1c55-4441-aee2-f429fdcc0328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:59.397827 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ecb3-1c55-4441-aee2-f429fdcc0328 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.398276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ecb3-1c55-4441-aee2-f429fdcc0328 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.398692 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ecb3-1c55-4441-aee2-f429fdcc0328 None admin] PATH_INFO: `/v3/users/f10d08f205e94ffba7c716cefd25d8b7` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.415828 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84ecb3-1c55-4441-aee2-f429fdcc0328 None admin] RBAC: Authorizing `identity:get_user(user_id=f10d08f205e94ffba7c716cefd25d8b7)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:59.417298 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84ecb3-1c55-4441-aee2-f429fdcc0328 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:59.419614 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 114/216] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:59 2022] GET /identity/v3/users/f10d08f205e94ffba7c716cefd25d8b7 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:59.425579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509627-a0cf-4e11-97b3-ace9f39e06e8 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:59.518502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84ecb3-1c55-4441-aee2-f429fdcc0328 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:59.539370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c509627-a0cf-4e11-97b3-ace9f39e06e8 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:59.568762 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:34:59.583527 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:59.584498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.584774 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.585041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.586297 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] RBAC: Adding query filter params (role.id=b03c99b693c24e2c91857f8ca6255e56, user.id=f10d08f205e94ffba7c716cefd25d8b7, scope.system=all) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:59.586297 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:59.588029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:59.596054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 103/217] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 24 08:34:59 2022] GET /identity/v3/role_assignments?user.id=f10d08f205e94ffba7c716cefd25d8b7&scope.system=all&role.id=b03c99b693c24e2c91857f8ca6255e56 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:59.661821 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84ecb3-1c55-4441-aee2-f429fdcc0328 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:59.703406 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffbe43-6b61-4b6d-a47d-515cc6b031ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:59.704071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffbe43-6b61-4b6d-a47d-515cc6b031ac None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.704390 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffbe43-6b61-4b6d-a47d-515cc6b031ac None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.704668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffbe43-6b61-4b6d-a47d-515cc6b031ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.717152 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffbe43-6b61-4b6d-a47d-515cc6b031ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-1fffbe43-6b61-4b6d-a47d-515cc6b031ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:34:59.722265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:34:59.723217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:34:59.724221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 115/218] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:34:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:34:59.733049 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:59.851941 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0e952-917c-47e0-a9b7-f78285f7b94b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:34:59.889594 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:34:59.890224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:59.890497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:59.890763 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:59.891437 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:34:59.891732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:34:59.893107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:34:59.902065 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 104/219] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:34:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:34:59.908810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffbe43-6b61-4b6d-a47d-515cc6b031ac None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:34:59.957346 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:00.023662 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffbe43-6b61-4b6d-a47d-515cc6b031ac None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:00.062576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b506b94-4ce0-44bf-8bdb-4422d6438056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:00.063217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506b94-4ce0-44bf-8bdb-4422d6438056 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:00.063489 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506b94-4ce0-44bf-8bdb-4422d6438056 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:00.063752 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b506b94-4ce0-44bf-8bdb-4422d6438056 None admin] PATH_INFO: `/v3/users/3031da18bbb54645bc6aefa83ca0e533` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:00.064898 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b506b94-4ce0-44bf-8bdb-4422d6438056 None admin] RBAC: Authorizing `identity:get_user(user_id=3031da18bbb54645bc6aefa83ca0e533)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:00.066379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b506b94-4ce0-44bf-8bdb-4422d6438056 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:00.068458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 116/220] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:34:59 2022] GET /identity/v3/users/3031da18bbb54645bc6aefa83ca0e533 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:00.074019 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:00.133386 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:00.190042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5195ab0-8d01-41d3-8e5c-4d2ef98c4e2b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:00.225527 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded991a-0a26-4d32-aaa7-20c19aa1c3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:00.226145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded991a-0a26-4d32-aaa7-20c19aa1c3b0 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:00.226407 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded991a-0a26-4d32-aaa7-20c19aa1c3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:00.226683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded991a-0a26-4d32-aaa7-20c19aa1c3b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:00.305591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded991a-0a26-4d32-aaa7-20c19aa1c3b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:00.307105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded991a-0a26-4d32-aaa7-20c19aa1c3b0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:00.365912 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:00.414667 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 105/221] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:00.420529 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b506b94-4ce0-44bf-8bdb-4422d6438056 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:00.530927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b506b94-4ce0-44bf-8bdb-4422d6438056 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:00.541139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:00.568630 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a72417-d823-4be9-abf3-63f0935c13b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:00.569287 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72417-d823-4be9-abf3-63f0935c13b0 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:00.569642 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72417-d823-4be9-abf3-63f0935c13b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:00.569916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72417-d823-4be9-abf3-63f0935c13b0 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:00.571114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a72417-d823-4be9-abf3-63f0935c13b0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:00.572599 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a72417-d823-4be9-abf3-63f0935c13b0 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:00.574641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 117/222] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:00 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:00.581050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded991a-0a26-4d32-aaa7-20c19aa1c3b0 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:00.684152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded991a-0a26-4d32-aaa7-20c19aa1c3b0 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:00.720334 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e890e-0199-4b06-a8ff-7035654fd14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:00.720959 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e890e-0199-4b06-a8ff-7035654fd14a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:00.721299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e890e-0199-4b06-a8ff-7035654fd14a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:00.721607 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e890e-0199-4b06-a8ff-7035654fd14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:00.722337 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e890e-0199-4b06-a8ff-7035654fd14a None admin] RBAC: Adding query filter params (role.id=0e0519c72ba44a218be35c26b72b2272, scope.project.id=d5f782cc6f7948768294e7961e8c66fb, user.id=3031da18bbb54645bc6aefa83ca0e533) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:00.722647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e890e-0199-4b06-a8ff-7035654fd14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:00.724077 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e890e-0199-4b06-a8ff-7035654fd14a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:00.730310 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 106/223] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:00 2022] GET /identity/v3/role_assignments?user.id=3031da18bbb54645bc6aefa83ca0e533&scope.project.id=d5f782cc6f7948768294e7961e8c66fb&role.id=0e0519c72ba44a218be35c26b72b2272 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:01.641412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8830af-dc8a-45e4-bb5c-6c775700580f None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:01.642299 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8830af-dc8a-45e4-bb5c-6c775700580f None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:01.642715 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8830af-dc8a-45e4-bb5c-6c775700580f None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:01.644320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 118/224] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:01.650423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3a38-32cf-4aab-93eb-9c2420a092c7 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:01.650942 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3a38-32cf-4aab-93eb-9c2420a092c7 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:01.650942 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3a38-32cf-4aab-93eb-9c2420a092c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:01.671374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-f0ff3a38-32cf-4aab-93eb-9c2420a092c7 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:01.672606 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f0ff3a38-32cf-4aab-93eb-9c2420a092c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:01.681242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:01.750288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 107/225] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:01.771648 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6320b98-945f-4b47-bb5e-0ddd161119bf None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:01.771935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6320b98-945f-4b47-bb5e-0ddd161119bf None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:01.772212 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6320b98-945f-4b47-bb5e-0ddd161119bf None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:01.773691 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 119/226] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:01.780318 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e684-412c-44ba-a8e7-ab4e39f87a5e None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:01.780628 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e684-412c-44ba-a8e7-ab4e39f87a5e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:01.780863 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617e684-412c-44ba-a8e7-ab4e39f87a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:01.801511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-f617e684-412c-44ba-a8e7-ab4e39f87a5e None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:01.802729 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f617e684-412c-44ba-a8e7-ab4e39f87a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:01.874135 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 108/227] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:01.907203 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ed38-d2b2-48bf-9876-e4cbd6478e6f None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:01.907446 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ed38-d2b2-48bf-9876-e4cbd6478e6f None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:01.907819 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ed38-d2b2-48bf-9876-e4cbd6478e6f None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:01.909478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 120/228] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:01.914566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9572-8aa4-4daf-af5c-26ca551329c0 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:01.914884 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9572-8aa4-4daf-af5c-26ca551329c0 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:01.915160 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9572-8aa4-4daf-af5c-26ca551329c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:01.935679 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-1b2b9572-8aa4-4daf-af5c-26ca551329c0 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:01.936908 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-1b2b9572-8aa4-4daf-af5c-26ca551329c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:02.015338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 109/229] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:02.021658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5ed38-d2b2-48bf-9876-e4cbd6478e6f None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.124983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5ed38-d2b2-48bf-9876-e4cbd6478e6f None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.159969 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390191-93d8-4ef7-9fb7-31629c048808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.160508 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390191-93d8-4ef7-9fb7-31629c048808 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.160786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390191-93d8-4ef7-9fb7-31629c048808 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.161055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390191-93d8-4ef7-9fb7-31629c048808 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.162775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b9572-8aa4-4daf-af5c-26ca551329c0 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.165309 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:02.174837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41390191-93d8-4ef7-9fb7-31629c048808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-41390191-93d8-4ef7-9fb7-31629c048808 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:02.181271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:02.182179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:02.182954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:02.183731 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 121/230] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:02.189191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390191-93d8-4ef7-9fb7-31629c048808 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.225164 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:02.286760 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b9572-8aa4-4daf-af5c-26ca551329c0 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.298500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390191-93d8-4ef7-9fb7-31629c048808 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.321128 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cab94-f586-4793-9b00-2255460852f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.321796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cab94-f586-4793-9b00-2255460852f3 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.322068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cab94-f586-4793-9b00-2255460852f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.322335 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cab94-f586-4793-9b00-2255460852f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.323432 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cab94-f586-4793-9b00-2255460852f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:02.324868 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cab94-f586-4793-9b00-2255460852f3 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:02.327148 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 110/231] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:02.327820 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cab94-f586-4793-9b00-2255460852f3 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.335746 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.336357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.336632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.336905 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.337674 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:02.337976 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:02.339371 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:02.348373 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 122/232] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:02.348373 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.397426 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:02.429811 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cab94-f586-4793-9b00-2255460852f3 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.448048 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:02.451745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734e12e-b5e8-4799-a3e9-6849bf03e241 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.463737 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964da6c-88b7-4d99-9d17-80e8d3bf3a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.464370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964da6c-88b7-4d99-9d17-80e8d3bf3a59 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.464648 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964da6c-88b7-4d99-9d17-80e8d3bf3a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.464917 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964da6c-88b7-4d99-9d17-80e8d3bf3a59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.475752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964da6c-88b7-4d99-9d17-80e8d3bf3a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-5964da6c-88b7-4d99-9d17-80e8d3bf3a59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:02.481000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:02.482039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 111/233] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:02.482940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964da6c-88b7-4d99-9d17-80e8d3bf3a59 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.490282 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c99a0d-0ff4-40cc-b03a-848cb764877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.491141 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99a0d-0ff4-40cc-b03a-848cb764877a None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.491420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99a0d-0ff4-40cc-b03a-848cb764877a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.492111 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c99a0d-0ff4-40cc-b03a-848cb764877a None admin] PATH_INFO: `/v3/groups` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.492737 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c99a0d-0ff4-40cc-b03a-848cb764877a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:02.494226 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c99a0d-0ff4-40cc-b03a-848cb764877a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:02.521473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 123/234] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Oct 24 08:35:02 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:02.521473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c99a0d-0ff4-40cc-b03a-848cb764877a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964da6c-88b7-4d99-9d17-80e8d3bf3a59 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.631665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:02.638347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c99a0d-0ff4-40cc-b03a-848cb764877a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.638746 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35dcf9-667f-4bca-834e-8970aab90e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.639398 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35dcf9-667f-4bca-834e-8970aab90e70 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.639670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35dcf9-667f-4bca-834e-8970aab90e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.640248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35dcf9-667f-4bca-834e-8970aab90e70 None admin] PATH_INFO: `/v3/users/a00b69eeacaf4cba859425dcf8002de3` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.661676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35dcf9-667f-4bca-834e-8970aab90e70 None admin] RBAC: Authorizing `identity:get_user(user_id=a00b69eeacaf4cba859425dcf8002de3)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:02.663173 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35dcf9-667f-4bca-834e-8970aab90e70 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:02.670598 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 112/235] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:02 2022] GET /identity/v3/users/a00b69eeacaf4cba859425dcf8002de3 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:02.670991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35dcf9-667f-4bca-834e-8970aab90e70 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.682297 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.682834 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.683102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.683376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.684050 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] RBAC: Adding query filter params (name=member) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:02.684351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:02.686318 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:02.696109 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 124/236] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:02.701967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.734039 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:02.800975 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35dcf9-667f-4bca-834e-8970aab90e70 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.815382 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bac65-9a22-4354-b6fc-e2370505ac2c None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:02.840190 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.841512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.841859 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.842140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.842866 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] RBAC: Adding query filter params (role.id=0e0519c72ba44a218be35c26b72b2272, user.id=a00b69eeacaf4cba859425dcf8002de3, scope.system=all) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:02.843168 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:02.845529 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:02.849678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03a5c6-4430-47db-8be7-d91f8b939732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:02.850316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03a5c6-4430-47db-8be7-d91f8b939732 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:02.850584 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03a5c6-4430-47db-8be7-d91f8b939732 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:02.850926 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03a5c6-4430-47db-8be7-d91f8b939732 None admin] PATH_INFO: `/v3/users/f10d08f205e94ffba7c716cefd25d8b7` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:02.858972 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 113/237] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 24 08:35:02 2022] GET /identity/v3/role_assignments?user.id=a00b69eeacaf4cba859425dcf8002de3&scope.system=all&role.id=0e0519c72ba44a218be35c26b72b2272 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:02.859813 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03a5c6-4430-47db-8be7-d91f8b939732 None admin] RBAC: Authorizing `identity:get_user(user_id=f10d08f205e94ffba7c716cefd25d8b7)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:02.861341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03a5c6-4430-47db-8be7-d91f8b939732 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:02.863176 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 125/238] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:02 2022] GET /identity/v3/users/f10d08f205e94ffba7c716cefd25d8b7 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:02.869304 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:02.929565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:02.991357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93dad6-9e1c-414f-b64b-68dcaf5f3100 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:03.030305 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c5a0a-1528-4ce8-bde6-6770b6e3c3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:03.030964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5a0a-1528-4ce8-bde6-6770b6e3c3f7 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:03.031237 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5a0a-1528-4ce8-bde6-6770b6e3c3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:03.031503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5a0a-1528-4ce8-bde6-6770b6e3c3f7 None admin] PATH_INFO: `/v3/system/users/f10d08f205e94ffba7c716cefd25d8b7/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:03.032925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c5a0a-1528-4ce8-bde6-6770b6e3c3f7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f10d08f205e94ffba7c716cefd25d8b7, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:03.034337 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c5a0a-1528-4ce8-bde6-6770b6e3c3f7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:03.045010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 114/239] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Oct 24 08:35:02 2022] PUT /identity/v3/system/users/f10d08f205e94ffba7c716cefd25d8b7/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:04.788739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dca3d-c9ef-49ef-9f36-11f39e2dd949 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:04.789310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dca3d-c9ef-49ef-9f36-11f39e2dd949 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:04.789310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dca3d-c9ef-49ef-9f36-11f39e2dd949 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:04.790769 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 126/240] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:04.797001 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47248-df6a-40fd-bbea-2fe5c924de58 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:04.797543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47248-df6a-40fd-bbea-2fe5c924de58 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:04.797617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47248-df6a-40fd-bbea-2fe5c924de58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:04.817601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-57c47248-df6a-40fd-bbea-2fe5c924de58 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:04.818807 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-57c47248-df6a-40fd-bbea-2fe5c924de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:04.887777 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 115/241] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:05.064464 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13e640-68ca-42f7-93d7-d67c27572e6a None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.064651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13e640-68ca-42f7-93d7-d67c27572e6a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.064920 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13e640-68ca-42f7-93d7-d67c27572e6a None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.066449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 127/242] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:05.071421 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ec82-bf9d-4464-8282-546630099a5e None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.071709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ec82-bf9d-4464-8282-546630099a5e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.071984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ec82-bf9d-4464-8282-546630099a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.090913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d058ec82-bf9d-4464-8282-546630099a5e None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:05.092322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d058ec82-bf9d-4464-8282-546630099a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:05.144200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:05.162834 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13e640-68ca-42f7-93d7-d67c27572e6a None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:05.174833 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 116/243] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:05.230397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13309f-acc9-4c7a-a790-4ce10289b8d1 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.230718 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13309f-acc9-4c7a-a790-4ce10289b8d1 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.230945 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13309f-acc9-4c7a-a790-4ce10289b8d1 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.232546 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 117/244] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:05.238628 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da8163-c8f6-409e-a768-a99afee0dec6 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.238910 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da8163-c8f6-409e-a768-a99afee0dec6 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.239182 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da8163-c8f6-409e-a768-a99afee0dec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.257840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-f3da8163-c8f6-409e-a768-a99afee0dec6 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:05.259029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f3da8163-c8f6-409e-a768-a99afee0dec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:05.270184 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:05.288048 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13e640-68ca-42f7-93d7-d67c27572e6a None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:05.326376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63c8ef-e7b1-4c96-bc44-e842c90a7da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:05.327087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63c8ef-e7b1-4c96-bc44-e842c90a7da3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.327366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63c8ef-e7b1-4c96-bc44-e842c90a7da3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.327650 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63c8ef-e7b1-4c96-bc44-e842c90a7da3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.328756 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63c8ef-e7b1-4c96-bc44-e842c90a7da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:05.330228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63c8ef-e7b1-4c96-bc44-e842c90a7da3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:05.333490 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 128/245] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:05.337358 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63c8ef-e7b1-4c96-bc44-e842c90a7da3 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:05.361465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 118/246] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:05.444635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da8163-c8f6-409e-a768-a99afee0dec6 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:05.453309 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63c8ef-e7b1-4c96-bc44-e842c90a7da3 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:05.491598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b3532-debc-4b1e-9026-63a8f4ce351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:05.492224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b3532-debc-4b1e-9026-63a8f4ce351a None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.492642 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b3532-debc-4b1e-9026-63a8f4ce351a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.492916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b3532-debc-4b1e-9026-63a8f4ce351a None admin] PATH_INFO: `/v3/groups` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.493954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b3532-debc-4b1e-9026-63a8f4ce351a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:05.495578 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b3532-debc-4b1e-9026-63a8f4ce351a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:05.517473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 129/247] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Oct 24 08:35:05 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:35:05.559077 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da8163-c8f6-409e-a768-a99afee0dec6 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:05.568131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:05.607873 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f67324-2b65-4b42-ab6c-cd504fc161e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:05.608463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67324-2b65-4b42-ab6c-cd504fc161e8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.608742 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67324-2b65-4b42-ab6c-cd504fc161e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.609012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67324-2b65-4b42-ab6c-cd504fc161e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.621023 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f67324-2b65-4b42-ab6c-cd504fc161e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-e0f67324-2b65-4b42-ab6c-cd504fc161e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:05.626514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:05.627496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:05.628299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:05.632676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 119/248] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:05.633532 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b3532-debc-4b1e-9026-63a8f4ce351a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:05.636611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f67324-2b65-4b42-ab6c-cd504fc161e8 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:05.657417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:05.757085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b3532-debc-4b1e-9026-63a8f4ce351a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:05.761565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f67324-2b65-4b42-ab6c-cd504fc161e8 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:05.798598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:05.799899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.800904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.800904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.801189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] RBAC: Adding query filter params (name=reader) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:05.802535 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:05.804142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:05.805223 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68966e2f-3327-46db-929d-d3ba41a17655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:05.806195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966e2f-3327-46db-929d-d3ba41a17655 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:05.806466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966e2f-3327-46db-929d-d3ba41a17655 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:05.807093 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68966e2f-3327-46db-929d-d3ba41a17655 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:05.815404 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 130/249] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:05.819300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:05.825169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68966e2f-3327-46db-929d-d3ba41a17655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-68966e2f-3327-46db-929d-d3ba41a17655 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:05.832461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:05.833620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:05.834595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:05.837498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 120/250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:05.840132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68966e2f-3327-46db-929d-d3ba41a17655 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:05.884271 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:05.942608 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:05.974025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5b31d-69cf-4790-8585-7c82e49d7cde None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:05.992029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68966e2f-3327-46db-929d-d3ba41a17655 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:06.014244 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d72f6c-bfbf-45c0-8b10-00bc22907f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:06.014891 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d72f6c-bfbf-45c0-8b10-00bc22907f29 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:06.015280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d72f6c-bfbf-45c0-8b10-00bc22907f29 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:06.015556 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d72f6c-bfbf-45c0-8b10-00bc22907f29 None admin] PATH_INFO: `/v3/users/a00b69eeacaf4cba859425dcf8002de3` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:06.016693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d72f6c-bfbf-45c0-8b10-00bc22907f29 None admin] RBAC: Authorizing `identity:get_user(user_id=a00b69eeacaf4cba859425dcf8002de3)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:06.018277 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d72f6c-bfbf-45c0-8b10-00bc22907f29 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:06.020269 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 131/251] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:05 2022] GET /identity/v3/users/a00b69eeacaf4cba859425dcf8002de3 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:06.025739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d72f6c-bfbf-45c0-8b10-00bc22907f29 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:06.030506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:06.031130 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:06.031406 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:06.031673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:06.032339 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:06.032638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:06.034145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:06.046790 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 121/252] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:06.053479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:06.162405 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:06.172662 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d72f6c-bfbf-45c0-8b10-00bc22907f29 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:06.178987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16f32-e55f-4ee6-adc0-db546df44bf4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:06.218407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b97dfb-d579-4a63-a4ef-a0fb72404c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:06.219185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97dfb-d579-4a63-a4ef-a0fb72404c8c None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:06.219521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97dfb-d579-4a63-a4ef-a0fb72404c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:06.219854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97dfb-d579-4a63-a4ef-a0fb72404c8c None admin] PATH_INFO: `/v3/system/users/a00b69eeacaf4cba859425dcf8002de3/roles/0e0519c72ba44a218be35c26b72b2272` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:06.220890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eea7d8-a4f9-4608-a68b-a8af333a6196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:06.221399 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b97dfb-d579-4a63-a4ef-a0fb72404c8c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a00b69eeacaf4cba859425dcf8002de3, role_id=0e0519c72ba44a218be35c26b72b2272)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:06.221718 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eea7d8-a4f9-4608-a68b-a8af333a6196 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:06.222062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eea7d8-a4f9-4608-a68b-a8af333a6196 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:06.222420 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eea7d8-a4f9-4608-a68b-a8af333a6196 None admin] PATH_INFO: `/v3/users/f10d08f205e94ffba7c716cefd25d8b7` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:06.223106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b97dfb-d579-4a63-a4ef-a0fb72404c8c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:06.223697 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eea7d8-a4f9-4608-a68b-a8af333a6196 None admin] RBAC: Authorizing `identity:get_user(user_id=f10d08f205e94ffba7c716cefd25d8b7)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:06.225404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eea7d8-a4f9-4608-a68b-a8af333a6196 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:06.227986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 122/253] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:06 2022] GET /identity/v3/users/f10d08f205e94ffba7c716cefd25d8b7 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:06.234585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eea7d8-a4f9-4608-a68b-a8af333a6196 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:06.239135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 132/254] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Oct 24 08:35:06 2022] PUT /identity/v3/system/users/a00b69eeacaf4cba859425dcf8002de3/roles/0e0519c72ba44a218be35c26b72b2272 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:35:06.352555 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eea7d8-a4f9-4608-a68b-a8af333a6196 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:06.391272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ee381-6aa0-4040-8b34-093ff3ae7ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:06.391894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee381-6aa0-4040-8b34-093ff3ae7ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:06.392171 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee381-6aa0-4040-8b34-093ff3ae7ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:06.392441 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee381-6aa0-4040-8b34-093ff3ae7ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:06.393174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ee381-6aa0-4040-8b34-093ff3ae7ef2 None admin] RBAC: Adding query filter params (role.id=b03c99b693c24e2c91857f8ca6255e56, user.id=f10d08f205e94ffba7c716cefd25d8b7, scope.system=all) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:06.393514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ee381-6aa0-4040-8b34-093ff3ae7ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:06.395032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ee381-6aa0-4040-8b34-093ff3ae7ef2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:06.408756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 123/255] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 24 08:35:06 2022] GET /identity/v3/role_assignments?user.id=f10d08f205e94ffba7c716cefd25d8b7&scope.system=all&role.id=b03c99b693c24e2c91857f8ca6255e56 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:08.345170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef1a1c-d3d3-4c7a-b0a8-707e21a6f826 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.345905 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef1a1c-d3d3-4c7a-b0a8-707e21a6f826 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef1a1c-d3d3-4c7a-b0a8-707e21a6f826 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:08.349061 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 133/256] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:08.357193 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f098-e29d-4be5-adc3-7b58525680d7 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.357927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f098-e29d-4be5-adc3-7b58525680d7 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.358167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343f098-e29d-4be5-adc3-7b58525680d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:08.396127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-0343f098-e29d-4be5-adc3-7b58525680d7 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:08.398163 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-0343f098-e29d-4be5-adc3-7b58525680d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:08.427891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:08.541248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 124/257] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:35:08.964018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b11f4-541a-4035-bfc0-7a2b5391eda9 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.964417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b11f4-541a-4035-bfc0-7a2b5391eda9 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.964588 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b11f4-541a-4035-bfc0-7a2b5391eda9 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:08.966452 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 134/258] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:08.972818 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c989f0-97bc-441d-b5f3-59d61caebc7d None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.973154 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c989f0-97bc-441d-b5f3-59d61caebc7d None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.973991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c989f0-97bc-441d-b5f3-59d61caebc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.009798 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-a8c989f0-97bc-441d-b5f3-59d61caebc7d None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:09.011559 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-a8c989f0-97bc-441d-b5f3-59d61caebc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:09.024329 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 125/259] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 24 08:35:09.111308 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b11f4-541a-4035-bfc0-7a2b5391eda9 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.129118 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b11f4-541a-4035-bfc0-7a2b5391eda9 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.133843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff6c5-6d95-4e74-8908-38dc9cd1afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.134718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff6c5-6d95-4e74-8908-38dc9cd1afde admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.135195 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff6c5-6d95-4e74-8908-38dc9cd1afde admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.135666 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff6c5-6d95-4e74-8908-38dc9cd1afde admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.145141 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:09.149579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ff6c5-6d95-4e74-8908-38dc9cd1afde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-f55ff6c5-6d95-4e74-8908-38dc9cd1afde admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:09.155974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:09.157983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:09.160092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 135/260] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 24 08:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:09.165484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c989f0-97bc-441d-b5f3-59d61caebc7d None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.175851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c989f0-97bc-441d-b5f3-59d61caebc7d None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.186110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.186602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.187258 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.188006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] RBAC: Adding query filter params (name=member) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:09.188339 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:09.190501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING py.warnings [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:35:09.190501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: warnings.warn(msg) Oct 24 08:35:09.190501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: Oct 24 08:35:09.191555 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:09.209239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 126/261] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:09.217951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff6c5-6d95-4e74-8908-38dc9cd1afde admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.231622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff6c5-6d95-4e74-8908-38dc9cd1afde admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.239839 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.240502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.241089 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.241373 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] PATH_INFO: `/v3/groups/d5ea1f79283a4268a4aec4f5e2867660` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.250424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5ea1f79283a4268a4aec4f5e2867660)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:09.252259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING py.warnings [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:35:09.252259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: warnings.warn(msg) Oct 24 08:35:09.252259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: Oct 24 08:35:09.253530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:09.255182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 136/262] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 24 08:35:09 2022] GET /identity/v3/groups/d5ea1f79283a4268a4aec4f5e2867660 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:09.263439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.273480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d0b3b-3d5a-44e6-8a43-e80cdede62ba admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.281808 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f8ef2-2ee1-445a-8db5-2564a1b9129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.282448 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8ef2-2ee1-445a-8db5-2564a1b9129c admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.282714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8ef2-2ee1-445a-8db5-2564a1b9129c admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.282979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8ef2-2ee1-445a-8db5-2564a1b9129c admin admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.287845 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f8ef2-2ee1-445a-8db5-2564a1b9129c admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:09.290028 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f8ef2-2ee1-445a-8db5-2564a1b9129c admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:09.291762 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 127/263] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 24 08:35:09 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:09.301300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.314567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54b9b3-508e-41f6-8f75-bafb33656199 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.319139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9312-2a49-4a8f-9292-aca041ec70b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.319844 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9312-2a49-4a8f-9292-aca041ec70b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.320102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9312-2a49-4a8f-9292-aca041ec70b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.320380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9312-2a49-4a8f-9292-aca041ec70b1 admin admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e/groups/d5ea1f79283a4268a4aec4f5e2867660/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.322301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b9312-2a49-4a8f-9292-aca041ec70b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee02727048b419d8fdf7b23539e940e, group_id=d5ea1f79283a4268a4aec4f5e2867660, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:09.323361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING py.warnings [None req-b02b9312-2a49-4a8f-9292-aca041ec70b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:35:09.323361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: warnings.warn(msg) Oct 24 08:35:09.323361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: Oct 24 08:35:09.325518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b9312-2a49-4a8f-9292-aca041ec70b1 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:09.350484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 137/264] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 24 08:35:09 2022] PUT /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e/groups/d5ea1f79283a4268a4aec4f5e2867660/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:09.442530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611b84-59de-4fb7-9c62-6e4635487007 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.443385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611b84-59de-4fb7-9c62-6e4635487007 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.443385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611b84-59de-4fb7-9c62-6e4635487007 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.444390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 128/265] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:09.452782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224538-2060-4ac0-be71-7c58a6739add None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.453147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224538-2060-4ac0-be71-7c58a6739add None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.453353 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224538-2060-4ac0-be71-7c58a6739add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.481183 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-78224538-2060-4ac0-be71-7c58a6739add None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:09.482656 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-78224538-2060-4ac0-be71-7c58a6739add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:09.568384 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 138/266] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:35:09.628894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611b84-59de-4fb7-9c62-6e4635487007 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.650333 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611b84-59de-4fb7-9c62-6e4635487007 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.655992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41af504-e69c-4554-bf03-5f53b142208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.656790 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af504-e69c-4554-bf03-5f53b142208f admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.657090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af504-e69c-4554-bf03-5f53b142208f admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.657418 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af504-e69c-4554-bf03-5f53b142208f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.674221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41af504-e69c-4554-bf03-5f53b142208f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-d41af504-e69c-4554-bf03-5f53b142208f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:09.680781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:09.684121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:09.689773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 129/267] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 24 08:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:09.692269 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78224538-2060-4ac0-be71-7c58a6739add None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.704351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78224538-2060-4ac0-be71-7c58a6739add None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.713950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.714563 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.714842 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.715112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.715774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] RBAC: Adding query filter params (name=member) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:09.716637 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:09.717675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING py.warnings [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:35:09.717675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: warnings.warn(msg) Oct 24 08:35:09.717675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: Oct 24 08:35:09.718572 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:09.734133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 139/268] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:09.739366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41af504-e69c-4554-bf03-5f53b142208f admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.749850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41af504-e69c-4554-bf03-5f53b142208f admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.761125 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.761849 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.762100 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.762429 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] PATH_INFO: `/v3/groups/d5ea1f79283a4268a4aec4f5e2867660` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.770229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5ea1f79283a4268a4aec4f5e2867660)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:09.771344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING py.warnings [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:35:09.771344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: warnings.warn(msg) Oct 24 08:35:09.771344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: Oct 24 08:35:09.772637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:09.774741 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 130/269] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 24 08:35:09 2022] GET /identity/v3/groups/d5ea1f79283a4268a4aec4f5e2867660 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:09.781168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.795698 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a505-72f4-4cf6-9bbe-cd51a91683fc admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.805300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d45c2-582c-4137-b2ee-accfc7f7ca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.805966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d45c2-582c-4137-b2ee-accfc7f7ca83 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.806298 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d45c2-582c-4137-b2ee-accfc7f7ca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.806527 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d45c2-582c-4137-b2ee-accfc7f7ca83 admin admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.810212 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d45c2-582c-4137-b2ee-accfc7f7ca83 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:09.812357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d45c2-582c-4137-b2ee-accfc7f7ca83 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:09.814369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 140/270] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 24 08:35:09 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:09.820624 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:09.837537 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25062b-d176-48fa-876d-063dbc4c5814 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:09.845065 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a41ff-1b5e-480e-8d7e-cf1bc96e4033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:09.845905 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a41ff-1b5e-480e-8d7e-cf1bc96e4033 admin admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:09.846288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a41ff-1b5e-480e-8d7e-cf1bc96e4033 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:09.846622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a41ff-1b5e-480e-8d7e-cf1bc96e4033 admin admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb/groups/d5ea1f79283a4268a4aec4f5e2867660/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:09.849819 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a41ff-1b5e-480e-8d7e-cf1bc96e4033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f782cc6f7948768294e7961e8c66fb, group_id=d5ea1f79283a4268a4aec4f5e2867660, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:09.850995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING py.warnings [None req-359a41ff-1b5e-480e-8d7e-cf1bc96e4033 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:35:09.850995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: warnings.warn(msg) Oct 24 08:35:09.850995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: Oct 24 08:35:09.857672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a41ff-1b5e-480e-8d7e-cf1bc96e4033 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:09.876464 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 131/271] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 24 08:35:09 2022] PUT /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb/groups/d5ea1f79283a4268a4aec4f5e2867660/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:35:10.005312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b32f7-ce5f-468f-9d69-9c1c0c0948b2 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.005623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b32f7-ce5f-468f-9d69-9c1c0c0948b2 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.005813 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b32f7-ce5f-468f-9d69-9c1c0c0948b2 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.007336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 141/272] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:10.019034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2fd8-54dc-45dc-bd81-435c6f9c3023 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.019366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2fd8-54dc-45dc-bd81-435c6f9c3023 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.019698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2fd8-54dc-45dc-bd81-435c6f9c3023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.048394 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-b2cb2fd8-54dc-45dc-bd81-435c6f9c3023 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:10.049813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-b2cb2fd8-54dc-45dc-bd81-435c6f9c3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:10.094763 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b32f7-ce5f-468f-9d69-9c1c0c0948b2 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:10.150983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 132/273] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:10.215133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b32f7-ce5f-468f-9d69-9c1c0c0948b2 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:10.221632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251301d-14b0-4598-96a7-f838d904dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:10.222548 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251301d-14b0-4598-96a7-f838d904dbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.222973 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251301d-14b0-4598-96a7-f838d904dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.223386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251301d-14b0-4598-96a7-f838d904dbf7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.238692 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251301d-14b0-4598-96a7-f838d904dbf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-6251301d-14b0-4598-96a7-f838d904dbf7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:10.248080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:10.249206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:10.250217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:10.252215 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 142/274] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 24 08:35:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:10.258451 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb2fd8-54dc-45dc-bd81-435c6f9c3023 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:10.269959 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb2fd8-54dc-45dc-bd81-435c6f9c3023 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:10.277199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18c8e-1284-4715-bac2-e04c1cd60748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:10.278162 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18c8e-1284-4715-bac2-e04c1cd60748 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.279216 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18c8e-1284-4715-bac2-e04c1cd60748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.279665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18c8e-1284-4715-bac2-e04c1cd60748 admin admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.280646 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18c8e-1284-4715-bac2-e04c1cd60748 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:10.281123 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18c8e-1284-4715-bac2-e04c1cd60748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:10.283109 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18c8e-1284-4715-bac2-e04c1cd60748 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:10.293778 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 133/275] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 24 08:35:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:10.300904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251301d-14b0-4598-96a7-f838d904dbf7 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:10.323290 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251301d-14b0-4598-96a7-f838d904dbf7 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:10.325079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b90343-eee5-41ab-b8dd-899d4b33d011 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.326174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b90343-eee5-41ab-b8dd-899d4b33d011 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.326670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b90343-eee5-41ab-b8dd-899d4b33d011 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.329061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 134/276] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:10.339479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cdeb8-bfac-4841-9b70-e74e33d99119 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.340033 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cdeb8-bfac-4841-9b70-e74e33d99119 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.340504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cdeb8-bfac-4841-9b70-e74e33d99119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.344811 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e0ce9-877f-40df-99ab-1b7f36a126b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:10.345703 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0ce9-877f-40df-99ab-1b7f36a126b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.346163 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0ce9-877f-40df-99ab-1b7f36a126b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.346648 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e0ce9-877f-40df-99ab-1b7f36a126b0 admin admin] PATH_INFO: `/v3/groups/d5ea1f79283a4268a4aec4f5e2867660` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.348481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e0ce9-877f-40df-99ab-1b7f36a126b0 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5ea1f79283a4268a4aec4f5e2867660)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:10.355314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e0ce9-877f-40df-99ab-1b7f36a126b0 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:10.362895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 143/277] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 24 08:35:10 2022] GET /identity/v3/groups/d5ea1f79283a4268a4aec4f5e2867660 => generated 226 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:10.378731 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e0ce9-877f-40df-99ab-1b7f36a126b0 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:10.387323 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-322cdeb8-bfac-4841-9b70-e74e33d99119 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:10.389394 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-322cdeb8-bfac-4841-9b70-e74e33d99119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:10.406863 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e0ce9-877f-40df-99ab-1b7f36a126b0 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:10.407046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 135/278] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 24 08:35:10.434983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181d22-1fd5-46f8-90c1-657f9efdfb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:10.436023 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181d22-1fd5-46f8-90c1-657f9efdfb2d admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.436558 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181d22-1fd5-46f8-90c1-657f9efdfb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.437026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181d22-1fd5-46f8-90c1-657f9efdfb2d admin admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.438562 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39181d22-1fd5-46f8-90c1-657f9efdfb2d admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:10.440983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39181d22-1fd5-46f8-90c1-657f9efdfb2d admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:10.442948 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 144/279] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 24 08:35:10 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:10.448855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cdeb8-bfac-4841-9b70-e74e33d99119 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:10.466970 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cdeb8-bfac-4841-9b70-e74e33d99119 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:10.474859 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03479d47-4ee3-4b4b-8a9d-70953610f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:10.475845 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479d47-4ee3-4b4b-8a9d-70953610f317 admin admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.476342 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479d47-4ee3-4b4b-8a9d-70953610f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.476907 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03479d47-4ee3-4b4b-8a9d-70953610f317 admin admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e/groups/d5ea1f79283a4268a4aec4f5e2867660/roles/02120488143f46a0aeda93d292f562c5` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.479439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03479d47-4ee3-4b4b-8a9d-70953610f317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee02727048b419d8fdf7b23539e940e, group_id=d5ea1f79283a4268a4aec4f5e2867660, role_id=02120488143f46a0aeda93d292f562c5)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:10.483062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03479d47-4ee3-4b4b-8a9d-70953610f317 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:10.511292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 136/280] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 24 08:35:10 2022] PUT /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e/groups/d5ea1f79283a4268a4aec4f5e2867660/roles/02120488143f46a0aeda93d292f562c5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:10.608253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181d22-1fd5-46f8-90c1-657f9efdfb2d admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:10.672210 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:10.748574 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181d22-1fd5-46f8-90c1-657f9efdfb2d admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:10.811854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f642c4-5e2c-432c-972b-838121487d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:10.812868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f642c4-5e2c-432c-972b-838121487d59 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.813721 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f642c4-5e2c-432c-972b-838121487d59 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.814278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f642c4-5e2c-432c-972b-838121487d59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.829892 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f642c4-5e2c-432c-972b-838121487d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:10.835827 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03479d47-4ee3-4b4b-8a9d-70953610f317 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-f6f642c4-5e2c-432c-972b-838121487d59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:10.837052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:10.837971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:10.838759 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 145/281] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:10.849261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f642c4-5e2c-432c-972b-838121487d59 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:10.866303 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:10.937175 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03479d47-4ee3-4b4b-8a9d-70953610f317 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:10.954465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae88fc8-ce3b-4b7f-8aca-d6e25be195ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:10.955538 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae88fc8-ce3b-4b7f-8aca-d6e25be195ba admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.956021 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae88fc8-ce3b-4b7f-8aca-d6e25be195ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.956488 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae88fc8-ce3b-4b7f-8aca-d6e25be195ba admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.986171 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae88fc8-ce3b-4b7f-8aca-d6e25be195ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-5ae88fc8-ce3b-4b7f-8aca-d6e25be195ba admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:10.991676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:10.992528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:10.993396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:10.998128 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 137/282] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 24 08:35:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:11.004020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae88fc8-ce3b-4b7f-8aca-d6e25be195ba admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:11.035749 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae88fc8-ce3b-4b7f-8aca-d6e25be195ba admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:11.050166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:11.050797 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:11.051076 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:11.051345 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:11.052022 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:11.052322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:11.053974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:11.069182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f642c4-5e2c-432c-972b-838121487d59 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:11.070741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:11.073503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 138/283] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 24 08:35:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:11.086499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:11.101796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d68086-c750-49f1-b0cd-42efc970a149 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:11.117209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193171df-8938-40fb-be11-86ef078184d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:11.118243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:11.118890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193171df-8938-40fb-be11-86ef078184d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:11.119483 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:11.119748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:11.120009 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:11.120726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193171df-8938-40fb-be11-86ef078184d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:11.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193171df-8938-40fb-be11-86ef078184d7 admin admin] PATH_INFO: `/v3/groups/d5ea1f79283a4268a4aec4f5e2867660` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:11.121713 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:11.122015 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:11.123244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193171df-8938-40fb-be11-86ef078184d7 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5ea1f79283a4268a4aec4f5e2867660)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:11.126453 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:11.128289 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193171df-8938-40fb-be11-86ef078184d7 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:11.133663 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 139/284] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 24 08:35:11 2022] GET /identity/v3/groups/d5ea1f79283a4268a4aec4f5e2867660 => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:11.136716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193171df-8938-40fb-be11-86ef078184d7 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:11.146757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 146/285] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:11.152727 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:11.155361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193171df-8938-40fb-be11-86ef078184d7 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:11.163229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01ba9-1f61-4875-a1b6-73272572cce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:11.164215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01ba9-1f61-4875-a1b6-73272572cce7 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:11.164687 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01ba9-1f61-4875-a1b6-73272572cce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:11.165178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c01ba9-1f61-4875-a1b6-73272572cce7 admin admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:11.166587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c01ba9-1f61-4875-a1b6-73272572cce7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:11.168968 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c01ba9-1f61-4875-a1b6-73272572cce7 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:11.171871 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 140/286] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 24 08:35:11 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:11.177201 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01ba9-1f61-4875-a1b6-73272572cce7 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:11.189524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c01ba9-1f61-4875-a1b6-73272572cce7 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:11.197506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2293c-f8c8-41d0-96a3-590812d60d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:11.198522 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2293c-f8c8-41d0-96a3-590812d60d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:11.198999 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2293c-f8c8-41d0-96a3-590812d60d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:11.199505 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2293c-f8c8-41d0-96a3-590812d60d1f admin admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb/groups/d5ea1f79283a4268a4aec4f5e2867660/roles/02120488143f46a0aeda93d292f562c5` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:11.202714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2293c-f8c8-41d0-96a3-590812d60d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f782cc6f7948768294e7961e8c66fb, group_id=d5ea1f79283a4268a4aec4f5e2867660, role_id=02120488143f46a0aeda93d292f562c5)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:11.205792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2293c-f8c8-41d0-96a3-590812d60d1f admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:11.228370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 141/287] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 24 08:35:11 2022] PUT /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb/groups/d5ea1f79283a4268a4aec4f5e2867660/roles/02120488143f46a0aeda93d292f562c5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:11.306744 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f1d2-07c0-49ac-ba96-8f37c449be99 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:11.349240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b1eb-ae63-477c-9a0f-9754736de292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:11.349859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b1eb-ae63-477c-9a0f-9754736de292 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:11.350168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b1eb-ae63-477c-9a0f-9754736de292 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:11.350494 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b1eb-ae63-477c-9a0f-9754736de292 None admin] PATH_INFO: `/v3/users/a00b69eeacaf4cba859425dcf8002de3` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:11.354226 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b1eb-ae63-477c-9a0f-9754736de292 None admin] RBAC: Authorizing `identity:get_user(user_id=a00b69eeacaf4cba859425dcf8002de3)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:11.355741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b1eb-ae63-477c-9a0f-9754736de292 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:11.358659 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 147/288] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:11 2022] GET /identity/v3/users/a00b69eeacaf4cba859425dcf8002de3 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:11.365021 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2293c-f8c8-41d0-96a3-590812d60d1f admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:11.531117 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2293c-f8c8-41d0-96a3-590812d60d1f admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:11.558900 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:11.572415 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc90c-b922-48d9-a8dc-a01a552ce44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:11.573499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc90c-b922-48d9-a8dc-a01a552ce44c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:11.574036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc90c-b922-48d9-a8dc-a01a552ce44c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:11.574525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc90c-b922-48d9-a8dc-a01a552ce44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:11.575537 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cc90c-b922-48d9-a8dc-a01a552ce44c None admin] RBAC: Adding query filter params (role.id=0e0519c72ba44a218be35c26b72b2272, user.id=a00b69eeacaf4cba859425dcf8002de3, scope.system=all) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:11.576053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cc90c-b922-48d9-a8dc-a01a552ce44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:11.577867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cc90c-b922-48d9-a8dc-a01a552ce44c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:11.598225 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 142/289] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Oct 24 08:35:11 2022] GET /identity/v3/role_assignments?user.id=a00b69eeacaf4cba859425dcf8002de3&scope.system=all&role.id=0e0519c72ba44a218be35c26b72b2272 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:12.001352 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022723b9-88ff-4690-af31-b460d46ee4d1 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.001698 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022723b9-88ff-4690-af31-b460d46ee4d1 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.002036 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022723b9-88ff-4690-af31-b460d46ee4d1 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.003672 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 148/290] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:12.009066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e3160-94e6-4546-884b-0af4bb9d9958 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.009350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e3160-94e6-4546-884b-0af4bb9d9958 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.009669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e3160-94e6-4546-884b-0af4bb9d9958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.035449 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-301e3160-94e6-4546-884b-0af4bb9d9958 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:12.036676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-301e3160-94e6-4546-884b-0af4bb9d9958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:12.113200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 143/291] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:35:12.525798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022723b9-88ff-4690-af31-b460d46ee4d1 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:12.543608 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022723b9-88ff-4690-af31-b460d46ee4d1 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:12.550969 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e5239-36f2-49d6-9351-48e24a21c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:12.551612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e5239-36f2-49d6-9351-48e24a21c08f admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.551925 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e5239-36f2-49d6-9351-48e24a21c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.552227 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e5239-36f2-49d6-9351-48e24a21c08f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.564222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e5239-36f2-49d6-9351-48e24a21c08f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-b97e5239-36f2-49d6-9351-48e24a21c08f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:12.570699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:12.571567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:12.572336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 149/292] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 24 08:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:12.578242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e3160-94e6-4546-884b-0af4bb9d9958 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:12.587556 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e3160-94e6-4546-884b-0af4bb9d9958 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:12.599882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:12.600506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.600786 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.601056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.601774 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:12.602075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:12.603698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:12.618002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 144/293] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 24 08:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:12.623157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e5239-36f2-49d6-9351-48e24a21c08f admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:12.639468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e5239-36f2-49d6-9351-48e24a21c08f admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:12.650310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916eb9a-c619-472f-a85c-2f71d4914ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:12.651389 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916eb9a-c619-472f-a85c-2f71d4914ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.651869 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916eb9a-c619-472f-a85c-2f71d4914ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.652351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916eb9a-c619-472f-a85c-2f71d4914ee0 admin admin] PATH_INFO: `/v3/groups/a20fa0b6e02b42bc97dec3714cccc6dd` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.659129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916eb9a-c619-472f-a85c-2f71d4914ee0 admin admin] RBAC: Authorizing `identity:get_group(group_id=a20fa0b6e02b42bc97dec3714cccc6dd)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:12.661484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916eb9a-c619-472f-a85c-2f71d4914ee0 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:12.663898 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 150/294] 10.222.0.23 () {56 vars in 1201 bytes} [Mon Oct 24 08:35:12 2022] GET /identity/v3/groups/a20fa0b6e02b42bc97dec3714cccc6dd => generated 229 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:12.669863 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:12.688070 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec32df-0280-4728-bb16-bc808f76d6b2 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:12.692747 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa640-c268-4bab-aa7e-8e13204e14b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:12.693413 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa640-c268-4bab-aa7e-8e13204e14b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.693741 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa640-c268-4bab-aa7e-8e13204e14b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.694018 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa640-c268-4bab-aa7e-8e13204e14b9 admin admin] PATH_INFO: `/v3/projects/cecb417d1d674088b180055893a0ccca` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.696058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa640-c268-4bab-aa7e-8e13204e14b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=cecb417d1d674088b180055893a0ccca)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:12.697908 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa640-c268-4bab-aa7e-8e13204e14b9 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:12.699847 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 145/295] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Oct 24 08:35:12 2022] GET /identity/v3/projects/cecb417d1d674088b180055893a0ccca => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:12.706315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916eb9a-c619-472f-a85c-2f71d4914ee0 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:12.722850 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916eb9a-c619-472f-a85c-2f71d4914ee0 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:12.729207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa977-5751-4fee-bf89-b1638a27eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:12.730175 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa977-5751-4fee-bf89-b1638a27eae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.730647 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa977-5751-4fee-bf89-b1638a27eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.731173 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa977-5751-4fee-bf89-b1638a27eae3 admin admin] PATH_INFO: `/v3/projects/cecb417d1d674088b180055893a0ccca/groups/a20fa0b6e02b42bc97dec3714cccc6dd/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.736651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caa977-5751-4fee-bf89-b1638a27eae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecb417d1d674088b180055893a0ccca, group_id=a20fa0b6e02b42bc97dec3714cccc6dd, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:12.739748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caa977-5751-4fee-bf89-b1638a27eae3 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:12.754505 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:12.759087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 151/296] 10.222.0.23 () {58 vars in 1463 bytes} [Mon Oct 24 08:35:12 2022] PUT /identity/v3/projects/cecb417d1d674088b180055893a0ccca/groups/a20fa0b6e02b42bc97dec3714cccc6dd/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:12.817946 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb460dd-ee46-425d-be6c-ab02db9f8a4c None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.818118 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb460dd-ee46-425d-be6c-ab02db9f8a4c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.818402 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb460dd-ee46-425d-be6c-ab02db9f8a4c None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.819786 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 146/297] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:12.826316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3780368-7456-4eff-86b9-27abb690474d None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.826679 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3780368-7456-4eff-86b9-27abb690474d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.826828 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3780368-7456-4eff-86b9-27abb690474d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.847382 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-b3780368-7456-4eff-86b9-27abb690474d None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:12.848584 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-b3780368-7456-4eff-86b9-27abb690474d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:12.937658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 152/298] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:13.342754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb460dd-ee46-425d-be6c-ab02db9f8a4c None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:13.453955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb460dd-ee46-425d-be6c-ab02db9f8a4c None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:13.478560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:13.501825 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5b71d-07e4-4087-9cb2-0b4378a32f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:13.502441 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b71d-07e4-4087-9cb2-0b4378a32f73 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.502723 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b71d-07e4-4087-9cb2-0b4378a32f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.503000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5b71d-07e4-4087-9cb2-0b4378a32f73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.520447 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5b71d-07e4-4087-9cb2-0b4378a32f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-47c5b71d-07e4-4087-9cb2-0b4378a32f73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:13.525307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:13.527357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:13.529282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 147/299] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:13.532494 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3780368-7456-4eff-86b9-27abb690474d None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:13.650444 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3780368-7456-4eff-86b9-27abb690474d None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:13.692537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:13.699287 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7d582-6cd6-4ea9-a59e-5de9d5a39bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:13.700407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7d582-6cd6-4ea9-a59e-5de9d5a39bc3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.701264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7d582-6cd6-4ea9-a59e-5de9d5a39bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.701560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7d582-6cd6-4ea9-a59e-5de9d5a39bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.702239 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7d582-6cd6-4ea9-a59e-5de9d5a39bc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:13.702535 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7d582-6cd6-4ea9-a59e-5de9d5a39bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:13.703901 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7d582-6cd6-4ea9-a59e-5de9d5a39bc3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:13.714087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 153/300] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:13.720378 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5b71d-07e4-4087-9cb2-0b4378a32f73 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:13.837335 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5b71d-07e4-4087-9cb2-0b4378a32f73 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:13.880875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89430843-76af-4bbc-a246-a24ea56efd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:13.881476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89430843-76af-4bbc-a246-a24ea56efd3a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.881756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89430843-76af-4bbc-a246-a24ea56efd3a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.882017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89430843-76af-4bbc-a246-a24ea56efd3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.882721 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ecf3-3804-4d61-8f59-e659f89822a5 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.883012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ecf3-3804-4d61-8f59-e659f89822a5 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.883285 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ecf3-3804-4d61-8f59-e659f89822a5 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.884729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 154/301] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:13.903160 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ac55-120c-4a41-8569-14dc6fecdfb6 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.903913 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ac55-120c-4a41-8569-14dc6fecdfb6 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.904223 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ac55-120c-4a41-8569-14dc6fecdfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.936767 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-eac1ac55-120c-4a41-8569-14dc6fecdfb6 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:13.938006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-eac1ac55-120c-4a41-8569-14dc6fecdfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:13.975706 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.025276 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89430843-76af-4bbc-a246-a24ea56efd3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.031705 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89430843-76af-4bbc-a246-a24ea56efd3a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.074942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 155/302] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:14.135581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ffcf5-f841-46d6-b741-9bd3ff77773c None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.135887 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ffcf5-f841-46d6-b741-9bd3ff77773c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.136128 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ffcf5-f841-46d6-b741-9bd3ff77773c None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.137823 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 156/303] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:14.161726 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae633-6daf-4682-a54f-27b09ca6a7ea None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.162138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae633-6daf-4682-a54f-27b09ca6a7ea None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.162541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ae633-6daf-4682-a54f-27b09ca6a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.167538 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 148/304] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:14.177176 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89430843-76af-4bbc-a246-a24ea56efd3a None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.189471 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-295ae633-6daf-4682-a54f-27b09ca6a7ea None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:14.190810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-295ae633-6daf-4682-a54f-27b09ca6a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:14.299883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.329636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89430843-76af-4bbc-a246-a24ea56efd3a None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.336172 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 157/305] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:14.389541 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41714-2485-4aac-9894-2014483377b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.390631 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41714-2485-4aac-9894-2014483377b3 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.391129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41714-2485-4aac-9894-2014483377b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.391659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41714-2485-4aac-9894-2014483377b3 None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.394264 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b41714-2485-4aac-9894-2014483377b3 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.395850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b41714-2485-4aac-9894-2014483377b3 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.397568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 149/306] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:14.403241 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ae633-6daf-4682-a54f-27b09ca6a7ea None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.434584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41714-2485-4aac-9894-2014483377b3 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.500871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.573341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ae633-6daf-4682-a54f-27b09ca6a7ea None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.595787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41714-2485-4aac-9894-2014483377b3 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.638108 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ed850-fbcc-4c8d-82e5-31d55cd15835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.638780 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed850-fbcc-4c8d-82e5-31d55cd15835 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.639063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed850-fbcc-4c8d-82e5-31d55cd15835 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.639606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ed850-fbcc-4c8d-82e5-31d55cd15835 None admin] PATH_INFO: `/v3/groups/d5ea1f79283a4268a4aec4f5e2867660` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.640775 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ed850-fbcc-4c8d-82e5-31d55cd15835 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ea1f79283a4268a4aec4f5e2867660)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.642865 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ed850-fbcc-4c8d-82e5-31d55cd15835 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.645130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 158/307] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/groups/d5ea1f79283a4268a4aec4f5e2867660 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:14.646490 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212563d8-688a-4c10-8ba8-5c078b36e697 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.646773 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212563d8-688a-4c10-8ba8-5c078b36e697 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.647045 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212563d8-688a-4c10-8ba8-5c078b36e697 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.648466 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 159/308] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:14.654702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243849-b15e-4128-90fa-b14971399547 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.655003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243849-b15e-4128-90fa-b14971399547 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.655343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243849-b15e-4128-90fa-b14971399547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.656224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d406ea-510a-441c-a202-70d00f6618d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.657062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d406ea-510a-441c-a202-70d00f6618d8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.657456 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d406ea-510a-441c-a202-70d00f6618d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.657813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d406ea-510a-441c-a202-70d00f6618d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.675671 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d406ea-510a-441c-a202-70d00f6618d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:14.678282 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-4a243849-b15e-4128-90fa-b14971399547 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:14.679602 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4a243849-b15e-4128-90fa-b14971399547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-68d406ea-510a-441c-a202-70d00f6618d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:14.681199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:14.683629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 150/309] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:14.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d406ea-510a-441c-a202-70d00f6618d8 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.688410 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.774317 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 160/310] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:14.775190 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a243849-b15e-4128-90fa-b14971399547 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.834853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.863361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d406ea-510a-441c-a202-70d00f6618d8 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.891810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a243849-b15e-4128-90fa-b14971399547 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.925224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.926264 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.926743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.927222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.928581 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] RBAC: Adding query filter params (group.id=d5ea1f79283a4268a4aec4f5e2867660, role.id=b03c99b693c24e2c91857f8ca6255e56, scope.project.id=7ee02727048b419d8fdf7b23539e940e) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:14.929121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.930583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.931200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.931477 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.931749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.931914 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.932420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] RBAC: Adding query filter params (name=member) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:14.932718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.934181 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.942657 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 151/311] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/role_assignments?group.id=d5ea1f79283a4268a4aec4f5e2867660&scope.project.id=7ee02727048b419d8fdf7b23539e940e&role.id=b03c99b693c24e2c91857f8ca6255e56 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:14.943096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 161/312] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:14.946361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.954368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.055172 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.093862 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deeefc-3e15-4a3d-b759-8095731291ee None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.095374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb14d7d-91f6-4c74-93b5-17d922f1ff06 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.119525 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e26b-4f79-4218-aaf7-d12c3d51f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.137773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e26b-4f79-4218-aaf7-d12c3d51f040 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.139002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e26b-4f79-4218-aaf7-d12c3d51f040 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.139437 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e26b-4f79-4218-aaf7-d12c3d51f040 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.154790 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e26b-4f79-4218-aaf7-d12c3d51f040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:15.158234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52cc0a-df95-42c1-8215-e468552946b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.158865 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52cc0a-df95-42c1-8215-e468552946b3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.159139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52cc0a-df95-42c1-8215-e468552946b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.159408 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52cc0a-df95-42c1-8215-e468552946b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-f4b9e26b-4f79-4218-aaf7-d12c3d51f040 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:15.160203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:15.161042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:15.161851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 152/313] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:15.162548 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e26b-4f79-4218-aaf7-d12c3d51f040 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.268368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52cc0a-df95-42c1-8215-e468552946b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:15.270938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52cc0a-df95-42c1-8215-e468552946b3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:15.306627 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e26b-4f79-4218-aaf7-d12c3d51f040 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.347767 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.360122 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e3dd0-d512-4518-847f-d411897f0776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.361036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e3dd0-d512-4518-847f-d411897f0776 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.361756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e3dd0-d512-4518-847f-d411897f0776 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.362193 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e3dd0-d512-4518-847f-d411897f0776 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.379069 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e3dd0-d512-4518-847f-d411897f0776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-b96e3dd0-d512-4518-847f-d411897f0776 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:15.386788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:15.387688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:15.389082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 153/314] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:35:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:15.390123 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e3dd0-d512-4518-847f-d411897f0776 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.428782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 162/315] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:15.430016 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52cc0a-df95-42c1-8215-e468552946b3 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.451709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.523889 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e3dd0-d512-4518-847f-d411897f0776 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.567643 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.568449 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.568730 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.569002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.570070 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:15.570371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:15.571767 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:15.572789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52cc0a-df95-42c1-8215-e468552946b3 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.580844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 154/316] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:15.581712 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.619279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.620486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.620766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.621039 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.621743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:15.622045 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:15.623955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:15.633335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 163/317] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:15.634034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.654466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.720515 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a9249-defd-4ea6-a1c5-ff1dd23f0330 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.732968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.764751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454cfc8-c3fa-4d50-9e15-1c37cb8b36d4 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.777125 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f02cf-de70-4654-a1b7-6e7ae56b98df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.778053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f02cf-de70-4654-a1b7-6e7ae56b98df None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.778561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f02cf-de70-4654-a1b7-6e7ae56b98df None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.780206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f02cf-de70-4654-a1b7-6e7ae56b98df None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.781610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f02cf-de70-4654-a1b7-6e7ae56b98df None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:15.783251 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f02cf-de70-4654-a1b7-6e7ae56b98df None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:15.785281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 155/318] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:15 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:15.786100 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f02cf-de70-4654-a1b7-6e7ae56b98df None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef448cd-b0be-425c-8693-95c7193e55d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.804859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef448cd-b0be-425c-8693-95c7193e55d8 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.805142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef448cd-b0be-425c-8693-95c7193e55d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.805413 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef448cd-b0be-425c-8693-95c7193e55d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.897827 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef448cd-b0be-425c-8693-95c7193e55d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:15.899406 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef448cd-b0be-425c-8693-95c7193e55d8 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:15.929218 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f02cf-de70-4654-a1b7-6e7ae56b98df None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.953852 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.984202 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211b4c-233b-4310-8149-2b3efcde41fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.984827 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211b4c-233b-4310-8149-2b3efcde41fb None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.985102 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211b4c-233b-4310-8149-2b3efcde41fb None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.985366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211b4c-233b-4310-8149-2b3efcde41fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.023975 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:16.071102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 164/319] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:16.071102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef448cd-b0be-425c-8693-95c7193e55d8 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.080461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211b4c-233b-4310-8149-2b3efcde41fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.082154 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211b4c-233b-4310-8149-2b3efcde41fb None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.211392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef448cd-b0be-425c-8693-95c7193e55d8 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:16.216930 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 156/320] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:16.217846 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211b4c-233b-4310-8149-2b3efcde41fb None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.237075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:16.255993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af194d-0aa7-473b-b27d-7a9be47b5fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:16.256632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af194d-0aa7-473b-b27d-7a9be47b5fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.256911 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af194d-0aa7-473b-b27d-7a9be47b5fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.257178 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af194d-0aa7-473b-b27d-7a9be47b5fe1 None admin] PATH_INFO: `/v3/groups/d5ea1f79283a4268a4aec4f5e2867660` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.258405 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af194d-0aa7-473b-b27d-7a9be47b5fe1 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ea1f79283a4268a4aec4f5e2867660)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.259847 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af194d-0aa7-473b-b27d-7a9be47b5fe1 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.261473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 165/321] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/groups/d5ea1f79283a4268a4aec4f5e2867660 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:16.262723 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c1d6-981e-4b1d-b526-89421f24f74a None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.263133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c1d6-981e-4b1d-b526-89421f24f74a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.263404 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948c1d6-981e-4b1d-b526-89421f24f74a None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.264752 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 166/322] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:16.265546 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948c1d6-981e-4b1d-b526-89421f24f74a None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.313971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:16.337220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211b4c-233b-4310-8149-2b3efcde41fb None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:16.372903 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948c1d6-981e-4b1d-b526-89421f24f74a None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:16.374319 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd526a-342e-4d8c-a1fc-c0a30d2e0e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:16.374955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd526a-342e-4d8c-a1fc-c0a30d2e0e5d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.375229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd526a-342e-4d8c-a1fc-c0a30d2e0e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.375495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd526a-342e-4d8c-a1fc-c0a30d2e0e5d None admin] PATH_INFO: `/v3/projects/7ee02727048b419d8fdf7b23539e940e` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.376622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd526a-342e-4d8c-a1fc-c0a30d2e0e5d None admin] RBAC: Authorizing `identity:get_project(project_id=7ee02727048b419d8fdf7b23539e940e)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.378072 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd526a-342e-4d8c-a1fc-c0a30d2e0e5d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.379722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 157/323] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/projects/7ee02727048b419d8fdf7b23539e940e => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:16.379722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd526a-342e-4d8c-a1fc-c0a30d2e0e5d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.412227 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0eeb8d-cb70-4d5b-85b7-a65c5f774745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:16.412859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eeb8d-cb70-4d5b-85b7-a65c5f774745 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.413135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eeb8d-cb70-4d5b-85b7-a65c5f774745 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.413402 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0eeb8d-cb70-4d5b-85b7-a65c5f774745 None admin] PATH_INFO: `/v3/projects/d5f782cc6f7948768294e7961e8c66fb` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.414594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0eeb8d-cb70-4d5b-85b7-a65c5f774745 None admin] RBAC: Authorizing `identity:get_project(project_id=d5f782cc6f7948768294e7961e8c66fb)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.416172 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0eeb8d-cb70-4d5b-85b7-a65c5f774745 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.417928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 167/324] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/projects/d5f782cc6f7948768294e7961e8c66fb => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:16.419342 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee77f-194b-49df-b0ed-44037931ccc1 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.419757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee77f-194b-49df-b0ed-44037931ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.419893 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee77f-194b-49df-b0ed-44037931ccc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.439716 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-582ee77f-194b-49df-b0ed-44037931ccc1 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:16.440933 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-582ee77f-194b-49df-b0ed-44037931ccc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:16.472262 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:16.491107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd526a-342e-4d8c-a1fc-c0a30d2e0e5d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:16.510590 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 168/325] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:16.511443 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee77f-194b-49df-b0ed-44037931ccc1 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.530229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:16.531212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.531634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.532068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.532943 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] RBAC: Adding query filter params (group.id=d5ea1f79283a4268a4aec4f5e2867660, role.id=b03c99b693c24e2c91857f8ca6255e56, scope.project.id=d5f782cc6f7948768294e7961e8c66fb) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:16.533391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.535105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.541551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 158/326] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/role_assignments?group.id=d5ea1f79283a4268a4aec4f5e2867660&scope.project.id=d5f782cc6f7948768294e7961e8c66fb&role.id=b03c99b693c24e2c91857f8ca6255e56 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:16.542347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.560357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:16.633286 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee77f-194b-49df-b0ed-44037931ccc1 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:16.674188 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e592ab-7f1d-43c2-8b90-18b34ff4c516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:16.675207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e592ab-7f1d-43c2-8b90-18b34ff4c516 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.675720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e592ab-7f1d-43c2-8b90-18b34ff4c516 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.676191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e592ab-7f1d-43c2-8b90-18b34ff4c516 None admin] PATH_INFO: `/v3/groups/d5ea1f79283a4268a4aec4f5e2867660` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.677749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e592ab-7f1d-43c2-8b90-18b34ff4c516 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ea1f79283a4268a4aec4f5e2867660)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.679497 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e592ab-7f1d-43c2-8b90-18b34ff4c516 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.681877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 169/327] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/groups/d5ea1f79283a4268a4aec4f5e2867660 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:16.688201 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e592ab-7f1d-43c2-8b90-18b34ff4c516 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.698332 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbc3aa-d37b-4308-81e8-547cb9fba8a0 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:16.752372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71860ba3-23ed-498a-9cfe-27787c6af7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:16.753022 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71860ba3-23ed-498a-9cfe-27787c6af7fb None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.753307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71860ba3-23ed-498a-9cfe-27787c6af7fb None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.753603 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71860ba3-23ed-498a-9cfe-27787c6af7fb None admin] PATH_INFO: `/v3/groups/d5ea1f79283a4268a4aec4f5e2867660` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.754716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71860ba3-23ed-498a-9cfe-27787c6af7fb None admin] RBAC: Authorizing `identity:get_group(group_id=d5ea1f79283a4268a4aec4f5e2867660)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.756417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71860ba3-23ed-498a-9cfe-27787c6af7fb None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.758997 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 159/328] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/groups/d5ea1f79283a4268a4aec4f5e2867660 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:16.765312 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71860ba3-23ed-498a-9cfe-27787c6af7fb None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.788495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:16.812271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e592ab-7f1d-43c2-8b90-18b34ff4c516 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:16.823662 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:16.850897 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:16.851508 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.851787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.852059 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.852786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] RBAC: Adding query filter params (group.id=d5ea1f79283a4268a4aec4f5e2867660, role.id=02120488143f46a0aeda93d292f562c5, scope.project.id=7ee02727048b419d8fdf7b23539e940e) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:16.853089 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.854658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.860952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 170/329] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/role_assignments?group.id=d5ea1f79283a4268a4aec4f5e2867660&scope.project.id=7ee02727048b419d8fdf7b23539e940e&role.id=02120488143f46a0aeda93d292f562c5 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:16.861783 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:16.888024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71860ba3-23ed-498a-9cfe-27787c6af7fb None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:16.928587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:16.929330 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:16.929913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:16.929913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:16.930731 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] RBAC: Adding query filter params (group.id=d5ea1f79283a4268a4aec4f5e2867660, role.id=02120488143f46a0aeda93d292f562c5, scope.project.id=d5f782cc6f7948768294e7961e8c66fb) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:16.931034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:16.932603 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:16.939691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 160/330] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/role_assignments?group.id=d5ea1f79283a4268a4aec4f5e2867660&scope.project.id=d5f782cc6f7948768294e7961e8c66fb&role.id=02120488143f46a0aeda93d292f562c5 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:16.993432 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437ef8d-6c0f-4854-b137-8304fbdddbee None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:17.035224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62067b1-a1ed-4178-b897-b0b550ba84bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:17.035878 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62067b1-a1ed-4178-b897-b0b550ba84bc None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:17.036154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62067b1-a1ed-4178-b897-b0b550ba84bc None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:17.036426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62067b1-a1ed-4178-b897-b0b550ba84bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:17.049914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62067b1-a1ed-4178-b897-b0b550ba84bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-d62067b1-a1ed-4178-b897-b0b550ba84bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:17.055292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:17.056234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:17.057030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 171/331] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:17.064197 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:17.163414 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:17.186850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe468aaf-79ff-43d5-b7a9-127042e5d6ec None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:17.223719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:17.223719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:17.223719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:17.223719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:17.224167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:17.224167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:17.224727 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:17.234784 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 161/332] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:17.240512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62067b1-a1ed-4178-b897-b0b550ba84bc None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:17.274302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:17.348184 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62067b1-a1ed-4178-b897-b0b550ba84bc None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:17.385901 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7efe-5652-4421-ad3a-f58c913b0816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:17.386510 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7efe-5652-4421-ad3a-f58c913b0816 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:17.386786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7efe-5652-4421-ad3a-f58c913b0816 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:17.387052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7efe-5652-4421-ad3a-f58c913b0816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:17.456415 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab7efe-5652-4421-ad3a-f58c913b0816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:17.457823 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab7efe-5652-4421-ad3a-f58c913b0816 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:17.489480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:17.562082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 172/333] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:17.567969 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:17.664226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99677f4c-b4a4-4ba7-b5b1-7098efff7709 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:17.696565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e183c62-98aa-4e12-a41c-588341b01179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:17.697187 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e183c62-98aa-4e12-a41c-588341b01179 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:17.697481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e183c62-98aa-4e12-a41c-588341b01179 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:17.697752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e183c62-98aa-4e12-a41c-588341b01179 None admin] PATH_INFO: `/v3/projects/cecb417d1d674088b180055893a0ccca` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:17.698854 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e183c62-98aa-4e12-a41c-588341b01179 None admin] RBAC: Authorizing `identity:get_project(project_id=cecb417d1d674088b180055893a0ccca)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:17.700485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e183c62-98aa-4e12-a41c-588341b01179 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:17.702145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 162/334] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:17 2022] GET /identity/v3/projects/cecb417d1d674088b180055893a0ccca => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:17.707756 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7efe-5652-4421-ad3a-f58c913b0816 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:17.805620 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7efe-5652-4421-ad3a-f58c913b0816 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:17.834235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:17.839606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b18d-b450-4df2-a9f4-17c62e7c1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:17.840234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b18d-b450-4df2-a9f4-17c62e7c1aee None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:17.840505 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b18d-b450-4df2-a9f4-17c62e7c1aee None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:17.840771 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b18d-b450-4df2-a9f4-17c62e7c1aee None admin] PATH_INFO: `/v3/groups/a20fa0b6e02b42bc97dec3714cccc6dd` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:17.842092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34b18d-b450-4df2-a9f4-17c62e7c1aee None admin] RBAC: Authorizing `identity:get_group(group_id=a20fa0b6e02b42bc97dec3714cccc6dd)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:17.843512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34b18d-b450-4df2-a9f4-17c62e7c1aee None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:17.845066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 173/335] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Oct 24 08:35:17 2022] GET /identity/v3/groups/a20fa0b6e02b42bc97dec3714cccc6dd => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:17.850946 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e183c62-98aa-4e12-a41c-588341b01179 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:17.864493 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:17.951442 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e183c62-98aa-4e12-a41c-588341b01179 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:17.984228 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c2245-bf3e-4dae-ae86-b0b1436b0073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:17.984829 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2245-bf3e-4dae-ae86-b0b1436b0073 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:17.985110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2245-bf3e-4dae-ae86-b0b1436b0073 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:17.985379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2245-bf3e-4dae-ae86-b0b1436b0073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:17.986128 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2245-bf3e-4dae-ae86-b0b1436b0073 None admin] RBAC: Adding query filter params (group.id=a20fa0b6e02b42bc97dec3714cccc6dd, role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=cecb417d1d674088b180055893a0ccca) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:17.986435 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2245-bf3e-4dae-ae86-b0b1436b0073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:17.987843 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2245-bf3e-4dae-ae86-b0b1436b0073 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:17.993909 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 163/336] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Oct 24 08:35:17 2022] GET /identity/v3/role_assignments?group.id=a20fa0b6e02b42bc97dec3714cccc6dd&scope.project.id=cecb417d1d674088b180055893a0ccca&role.id=ebf9799815574909aa1c88e93e213c96 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:20.769003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006edc-e2c2-41c2-a94d-8b4e2a14492d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:20.769003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006edc-e2c2-41c2-a94d-8b4e2a14492d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:20.769003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006edc-e2c2-41c2-a94d-8b4e2a14492d None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:20.770036 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 174/337] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:20.775894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a6c3-52c2-4901-a36a-30e03385dab2 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:20.776745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a6c3-52c2-4901-a36a-30e03385dab2 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:20.777240 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7a6c3-52c2-4901-a36a-30e03385dab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:20.785629 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cd77-a16a-467b-8eb6-9fe1a304ef36 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:20.786199 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cd77-a16a-467b-8eb6-9fe1a304ef36 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:20.786675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37cd77-a16a-467b-8eb6-9fe1a304ef36 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:20.789626 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 175/338] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:20.801423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c3d5-7850-4c0f-8624-632d3990f6c1 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:20.802030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c3d5-7850-4c0f-8624-632d3990f6c1 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:20.802515 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c3d5-7850-4c0f-8624-632d3990f6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:20.803977 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d1a7a6c3-52c2-4901-a36a-30e03385dab2 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:20.805220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d1a7a6c3-52c2-4901-a36a-30e03385dab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:20.838863 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-59d1c3d5-7850-4c0f-8624-632d3990f6c1 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:20.840065 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-59d1c3d5-7850-4c0f-8624-632d3990f6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:20.926846 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 164/339] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:20.941120 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 176/340] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:21.190306 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678a6bb-fce3-481f-81fe-22506b141641 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.190488 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678a6bb-fce3-481f-81fe-22506b141641 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.190746 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678a6bb-fce3-481f-81fe-22506b141641 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.192483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 165/341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:21.203233 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37898d-3ec7-4e23-90d5-c34da516ba24 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.203645 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37898d-3ec7-4e23-90d5-c34da516ba24 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.204224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37898d-3ec7-4e23-90d5-c34da516ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.218654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678a6bb-fce3-481f-81fe-22506b141641 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.222702 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:21.233467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-df37898d-3ec7-4e23-90d5-c34da516ba24 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:21.234168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-df37898d-3ec7-4e23-90d5-c34da516ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:21.349042 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 177/342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:21.350515 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37898d-3ec7-4e23-90d5-c34da516ba24 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.373596 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678a6bb-fce3-481f-81fe-22506b141641 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:21.431450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa94883-edc2-4209-89cb-4b1917779a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:21.432322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa94883-edc2-4209-89cb-4b1917779a26 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.432761 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa94883-edc2-4209-89cb-4b1917779a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.433170 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa94883-edc2-4209-89cb-4b1917779a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.451294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa94883-edc2-4209-89cb-4b1917779a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:21.452600 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa94883-edc2-4209-89cb-4b1917779a26 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:21.458804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-6aa94883-edc2-4209-89cb-4b1917779a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:21.472288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:21.473253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:21.474726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:21.474726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:21.474726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:21.474726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 166/343] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:21.474957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bf295-4792-4575-95e3-a73a87a67fb8 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.475237 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bf295-4792-4575-95e3-a73a87a67fb8 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.475515 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bf295-4792-4575-95e3-a73a87a67fb8 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.476847 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 167/344] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:21.479076 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bf295-4792-4575-95e3-a73a87a67fb8 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.523386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37898d-3ec7-4e23-90d5-c34da516ba24 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:21.562352 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:21.563576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144c8de-4fc7-45e6-981f-a781c2f2ef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:21.564457 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144c8de-4fc7-45e6-981f-a781c2f2ef02 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.564927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144c8de-4fc7-45e6-981f-a781c2f2ef02 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.565398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144c8de-4fc7-45e6-981f-a781c2f2ef02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.578424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144c8de-4fc7-45e6-981f-a781c2f2ef02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:21.580375 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144c8de-4fc7-45e6-981f-a781c2f2ef02 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-b144c8de-4fc7-45e6-981f-a781c2f2ef02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:21.597012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:21.597962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:21.598804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:21.598804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:21.598804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:21.605652 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 178/345] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:21.608553 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2efb1-7fea-4150-85d8-59c28196a04b None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.609047 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2efb1-7fea-4150-85d8-59c28196a04b None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.609817 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2efb1-7fea-4150-85d8-59c28196a04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.614301 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bf295-4792-4575-95e3-a73a87a67fb8 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:21.629770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-cae2efb1-7fea-4150-85d8-59c28196a04b None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:21.631445 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-cae2efb1-7fea-4150-85d8-59c28196a04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:21.655883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:21.656499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.656776 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.657111 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.657843 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:21.658146 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:21.659530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:21.672149 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 168/346] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:21.672907 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.706947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 179/347] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:21.718647 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2efb1-7fea-4150-85d8-59c28196a04b None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.777516 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:21.799770 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cceae23-3446-4efc-af13-2162998bf30d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:21.820174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:21.842339 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:21.843305 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.843765 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.844184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.844960 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:21.845414 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:21.847174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:21.849883 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2efb1-7fea-4150-85d8-59c28196a04b None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:21.861365 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 169/348] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:21.866803 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.886918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:21.888467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.888953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.889620 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.900574 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:21.902364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:21.918234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:21.919806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:21.920641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:21.920641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:21.920641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:21.922781 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 180/349] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:21.928633 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.989961 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf1457-8b17-426b-8e50-cc9a794a1022 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:22.030247 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cde9cc-e9bd-44a7-abec-56cb7d20d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:22.030866 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cde9cc-e9bd-44a7-abec-56cb7d20d7e2 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.031142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cde9cc-e9bd-44a7-abec-56cb7d20d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.031415 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cde9cc-e9bd-44a7-abec-56cb7d20d7e2 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.032066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cde9cc-e9bd-44a7-abec-56cb7d20d7e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:22.033326 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:22.033542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cde9cc-e9bd-44a7-abec-56cb7d20d7e2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:22.041000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05f65-c0c1-4d30-90fd-f6588395b448 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:22.065476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 170/350] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:21 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:22.065476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cde9cc-e9bd-44a7-abec-56cb7d20d7e2 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:22.102911 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404074c-2f4a-4a3f-96de-d252e41b4073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:22.103959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404074c-2f4a-4a3f-96de-d252e41b4073 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.104314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404074c-2f4a-4a3f-96de-d252e41b4073 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.104659 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404074c-2f4a-4a3f-96de-d252e41b4073 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.105749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404074c-2f4a-4a3f-96de-d252e41b4073 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:22.108783 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404074c-2f4a-4a3f-96de-d252e41b4073 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:22.110862 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:22.142758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 181/351] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:21 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:22.143512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404074c-2f4a-4a3f-96de-d252e41b4073 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:22.256758 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cde9cc-e9bd-44a7-abec-56cb7d20d7e2 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:22.304867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3486ce-715b-471e-8ec1-cdc11dd77f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:22.306044 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3486ce-715b-471e-8ec1-cdc11dd77f3c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.306609 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3486ce-715b-471e-8ec1-cdc11dd77f3c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.307084 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3486ce-715b-471e-8ec1-cdc11dd77f3c None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.307987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3486ce-715b-471e-8ec1-cdc11dd77f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:22.308502 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3486ce-715b-471e-8ec1-cdc11dd77f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:22.310371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3486ce-715b-471e-8ec1-cdc11dd77f3c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:22.323447 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 171/352] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:22.325828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3181c9-9721-4cfc-a06e-f6b93816aa11 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.326385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3181c9-9721-4cfc-a06e-f6b93816aa11 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.326869 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3181c9-9721-4cfc-a06e-f6b93816aa11 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.328872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 172/353] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:22.334322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d2983-22e3-4a13-b17c-2142bc92480c None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.334927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d2983-22e3-4a13-b17c-2142bc92480c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.335404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d2983-22e3-4a13-b17c-2142bc92480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.349162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404074c-2f4a-4a3f-96de-d252e41b4073 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:22.360485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-ae7d2983-22e3-4a13-b17c-2142bc92480c None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:22.362119 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-ae7d2983-22e3-4a13-b17c-2142bc92480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:22.394815 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:22.395455 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.395730 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.396001 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.409734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:22.410751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:22.431026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:22.431979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:22.439476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:22.439476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:22.439476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:22.439476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 182/354] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:22.439476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:22.439476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:22.454967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 173/355] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:22.455905 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d2983-22e3-4a13-b17c-2142bc92480c None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:22.501883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:22.603377 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f55970-3b2a-487a-87fa-0a10d10d27db None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:22.605485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d2983-22e3-4a13-b17c-2142bc92480c None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:22.645782 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:22.646811 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.647401 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.647851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.648676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:22.649421 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:22.651428 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:22.669760 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 174/356] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:22.671778 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:22.697482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa06940-999e-4989-84e0-70975bb0e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:22.697482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa06940-999e-4989-84e0-70975bb0e689 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.697482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa06940-999e-4989-84e0-70975bb0e689 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.697482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa06940-999e-4989-84e0-70975bb0e689 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.697930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa06940-999e-4989-84e0-70975bb0e689 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:22.697930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa06940-999e-4989-84e0-70975bb0e689 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:22.750275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 183/357] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:22 2022] POST /identity/v3/users => generated 248 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:22.751148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa06940-999e-4989-84e0-70975bb0e689 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:22.796248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:22.821765 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c05798-f496-4240-930a-1d4b1821caf2 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:22.865856 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69905e9c-7459-47c6-8485-f7b21d65169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:22.866658 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69905e9c-7459-47c6-8485-f7b21d65169b None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.866938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69905e9c-7459-47c6-8485-f7b21d65169b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.867220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69905e9c-7459-47c6-8485-f7b21d65169b None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.868050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69905e9c-7459-47c6-8485-f7b21d65169b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:22.869733 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69905e9c-7459-47c6-8485-f7b21d65169b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:22.871744 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:22.902637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 175/358] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:22 2022] POST /identity/v3/users => generated 249 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:35:22.942720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa06940-999e-4989-84e0-70975bb0e689 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:22.994909 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:22.995555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:22.995832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:22.996103 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:22.996810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:22.998976 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:23.015323 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.sql.core [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 08:35:23.015323 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 08:35:23.015323 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [parameters: {'id': '344984d2606f4c68adc688f2f54d84f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 08:35:23.015323 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88334) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result.read() Oct 24 08:35:23.033853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return ref.to_dict() Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:35:23.034786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application yield resource Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise self.value Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application session.commit() Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:35:23.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:35:23.036526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:35:23.037392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result.read() Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:35:23.039803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [parameters: {'id': '344984d2606f4c68adc688f2f54d84f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:23.041401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 08:35:23.047518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:23.049601 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 184/359] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 24 08:35:22 2022] POST /identity/v3/roles => generated 144 bytes in 285 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:23.049760 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69905e9c-7459-47c6-8485-f7b21d65169b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:23.180248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69905e9c-7459-47c6-8485-f7b21d65169b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:23.221058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdad0f8-931e-4961-9f48-e06b7a9141db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:23.221730 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdad0f8-931e-4961-9f48-e06b7a9141db None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:23.222005 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdad0f8-931e-4961-9f48-e06b7a9141db None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:23.222305 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdad0f8-931e-4961-9f48-e06b7a9141db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:23.231247 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:23.238716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdad0f8-931e-4961-9f48-e06b7a9141db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-ffdad0f8-931e-4961-9f48-e06b7a9141db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:23.244300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:23.246361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:23.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:23.249894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 176/360] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:35:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:23.253469 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:23.371330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d905e-9227-4c59-b9ee-e12b1a738b01 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:23.402004 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:23.418843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836327-8095-4178-af2e-ebe07e1416b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:23.420250 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836327-8095-4178-af2e-ebe07e1416b3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:23.420600 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836327-8095-4178-af2e-ebe07e1416b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:23.420878 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836327-8095-4178-af2e-ebe07e1416b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:23.421587 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe836327-8095-4178-af2e-ebe07e1416b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:23.421890 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe836327-8095-4178-af2e-ebe07e1416b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:23.423361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe836327-8095-4178-af2e-ebe07e1416b3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:23.433623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 185/361] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:24.746523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0fc75-235a-46d7-a139-f23e6cf19c70 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:24.746523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0fc75-235a-46d7-a139-f23e6cf19c70 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:24.746523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0fc75-235a-46d7-a139-f23e6cf19c70 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:24.747788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 177/362] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:24.753882 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7b5ab-7290-42ee-af02-278ace19d42f None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:24.754766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7b5ab-7290-42ee-af02-278ace19d42f None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:24.755246 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7b5ab-7290-42ee-af02-278ace19d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:24.780467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-43b7b5ab-7290-42ee-af02-278ace19d42f None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:24.782079 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-43b7b5ab-7290-42ee-af02-278ace19d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:24.885691 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 186/363] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:25.001646 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81508-5e04-41fe-be4c-13ff4c287069 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:25.002230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81508-5e04-41fe-be4c-13ff4c287069 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:25.002700 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81508-5e04-41fe-be4c-13ff4c287069 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:25.004499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 178/364] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:25.012343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac7348-4cd9-4827-9ac7-61013c5a5ef1 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:25.012986 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac7348-4cd9-4827-9ac7-61013c5a5ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:25.013483 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac7348-4cd9-4827-9ac7-61013c5a5ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:25.043314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-28ac7348-4cd9-4827-9ac7-61013c5a5ef1 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:25.045020 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-28ac7348-4cd9-4827-9ac7-61013c5a5ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:25.136008 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 187/365] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:25.252867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81508-5e04-41fe-be4c-13ff4c287069 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:25.392146 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81508-5e04-41fe-be4c-13ff4c287069 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:25.443979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb1451-4d91-46e4-a88b-d1796a651de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:25.444974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb1451-4d91-46e4-a88b-d1796a651de4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:25.445504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb1451-4d91-46e4-a88b-d1796a651de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:25.445976 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb1451-4d91-46e4-a88b-d1796a651de4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:25.462816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb1451-4d91-46e4-a88b-d1796a651de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-cacb1451-4d91-46e4-a88b-d1796a651de4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:25.467813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:25.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:25.469511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 179/366] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:25.476368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac7348-4cd9-4827-9ac7-61013c5a5ef1 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:25.556898 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:25.644326 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac7348-4cd9-4827-9ac7-61013c5a5ef1 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:25.690922 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:25.691550 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:25.691830 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:25.692099 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:25.692777 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] RBAC: Adding query filter params (name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:25.693077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:25.694554 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:25.707882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb1451-4d91-46e4-a88b-d1796a651de4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:25.708139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 188/367] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:25.718831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:25.794463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:25.853501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb1451-4d91-46e4-a88b-d1796a651de4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:25.867084 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392d11d-789b-4e0d-b885-059c2a706569 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:25.876892 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:25.903748 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5306bf-e498-42eb-8645-2660fdc8f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:25.904724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5306bf-e498-42eb-8645-2660fdc8f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:25.905183 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5306bf-e498-42eb-8645-2660fdc8f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:25.905729 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5306bf-e498-42eb-8645-2660fdc8f0f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:25.908713 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db3da6-a1fa-4445-96a6-135f7e2f1322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:25.909689 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3da6-a1fa-4445-96a6-135f7e2f1322 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:25.910189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3da6-a1fa-4445-96a6-135f7e2f1322 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:25.910677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3da6-a1fa-4445-96a6-135f7e2f1322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:25.917492 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5306bf-e498-42eb-8645-2660fdc8f0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:25.922970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db3da6-a1fa-4445-96a6-135f7e2f1322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-1d5306bf-e498-42eb-8645-2660fdc8f0f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:25.923213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:25.924263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:25.925234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:25.927519 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db3da6-a1fa-4445-96a6-135f7e2f1322 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:25.927816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 180/368] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:25.929233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b57d4-47dd-4f4a-9345-457731acaf60 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:25.929689 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b57d4-47dd-4f4a-9345-457731acaf60 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:25.930082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b57d4-47dd-4f4a-9345-457731acaf60 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:25.931498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 181/369] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:25.933144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b57d4-47dd-4f4a-9345-457731acaf60 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-65db3da6-a1fa-4445-96a6-135f7e2f1322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:25.949339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:25.951135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:25.952203 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:25.952203 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:25.952203 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:25.953514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 189/370] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:25.958899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de97d-edae-4f27-a379-b4579b12d62b None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:25.959298 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de97d-edae-4f27-a379-b4579b12d62b None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:25.959919 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de97d-edae-4f27-a379-b4579b12d62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:25.984346 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-270de97d-edae-4f27-a379-b4579b12d62b None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:25.985888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-270de97d-edae-4f27-a379-b4579b12d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:26.072390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b57d4-47dd-4f4a-9345-457731acaf60 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 190/371] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:26.078554 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270de97d-edae-4f27-a379-b4579b12d62b None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.102584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:26.129136 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd426bdd-f7b6-47b0-a982-8a0b5311c6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:26.130416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd426bdd-f7b6-47b0-a982-8a0b5311c6ea None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.131432 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd426bdd-f7b6-47b0-a982-8a0b5311c6ea None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.131918 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd426bdd-f7b6-47b0-a982-8a0b5311c6ea None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.133054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd426bdd-f7b6-47b0-a982-8a0b5311c6ea None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:26.133855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd426bdd-f7b6-47b0-a982-8a0b5311c6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:26.135882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd426bdd-f7b6-47b0-a982-8a0b5311c6ea None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:26.147002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 182/372] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:26.148448 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45251-99c4-4414-a2b7-28c661f4754b None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.148726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45251-99c4-4414-a2b7-28c661f4754b None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.148994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e45251-99c4-4414-a2b7-28c661f4754b None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.153495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 183/373] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:26.153495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e45251-99c4-4414-a2b7-28c661f4754b None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.186117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:26.201817 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270de97d-edae-4f27-a379-b4579b12d62b None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.243164 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50196-a63a-450f-9c26-6ff5d2811617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:26.244086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50196-a63a-450f-9c26-6ff5d2811617 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.244568 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50196-a63a-450f-9c26-6ff5d2811617 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.245107 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50196-a63a-450f-9c26-6ff5d2811617 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.246006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50196-a63a-450f-9c26-6ff5d2811617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:26.246508 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50196-a63a-450f-9c26-6ff5d2811617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:26.248190 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50196-a63a-450f-9c26-6ff5d2811617 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:26.268876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 191/374] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:26.270885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b48d2-a221-4a91-a95a-63aed54b085c None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.271562 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b48d2-a221-4a91-a95a-63aed54b085c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.272039 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b48d2-a221-4a91-a95a-63aed54b085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.295306 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-464b48d2-a221-4a91-a95a-63aed54b085c None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:26.297336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-464b48d2-a221-4a91-a95a-63aed54b085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:26.302443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e45251-99c4-4414-a2b7-28c661f4754b None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.346978 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:26.347628 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.347906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.348177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.362759 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:26.364530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:26.378092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 192/375] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:26.379327 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b48d2-a221-4a91-a95a-63aed54b085c None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:26.392938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:26.394030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:26.394874 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:26.394874 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:26.394874 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:26.397069 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 184/376] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:26.398239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.439860 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:26.486356 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:26.515004 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b48d2-a221-4a91-a95a-63aed54b085c None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.522439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e4d83-4a26-48bd-87e4-ce77408b3697 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.556910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:26.557515 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.557797 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.558068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.565646 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282c090-d769-4dca-aef5-bcaf37c7b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:26.566275 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c090-d769-4dca-aef5-bcaf37c7b77d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.566552 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c090-d769-4dca-aef5-bcaf37c7b77d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.566733 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:26.566840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c090-d769-4dca-aef5-bcaf37c7b77d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.568268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:26.578543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282c090-d769-4dca-aef5-bcaf37c7b77d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:26.583388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:26.584366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:35:26.586068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-e282c090-d769-4dca-aef5-bcaf37c7b77d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:26.586584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:26.587466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:26.588341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:26.589906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 193/377] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:26.589906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.590244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 185/378] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:26.595696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c696-88c5-4773-a6e2-ed62bf71febc None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.595696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c696-88c5-4773-a6e2-ed62bf71febc None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.595696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c696-88c5-4773-a6e2-ed62bf71febc None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.595696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 186/379] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:26.597571 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c696-88c5-4773-a6e2-ed62bf71febc None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.703711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:26.707289 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ac90-e3ee-437f-be6d-857f097718fd None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.713983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c696-88c5-4773-a6e2-ed62bf71febc None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.742644 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2a456-49b8-4434-9b8a-6b5cf310e900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:26.743260 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2a456-49b8-4434-9b8a-6b5cf310e900 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.743542 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2a456-49b8-4434-9b8a-6b5cf310e900 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.743814 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2a456-49b8-4434-9b8a-6b5cf310e900 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.744462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2a456-49b8-4434-9b8a-6b5cf310e900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:26.744763 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2a456-49b8-4434-9b8a-6b5cf310e900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:26.746193 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2a456-49b8-4434-9b8a-6b5cf310e900 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:26.749490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:26.750105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.750379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.750647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.751390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:26.751673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:26.753089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:26.754094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:26.759729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 194/380] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:26.760952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836664-bc8b-4f00-8d7d-940594c6c826 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.761232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836664-bc8b-4f00-8d7d-940594c6c826 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.761531 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836664-bc8b-4f00-8d7d-940594c6c826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.780004 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-be836664-bc8b-4f00-8d7d-940594c6c826 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:26.781219 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-be836664-bc8b-4f00-8d7d-940594c6c826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:26.797660 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 187/381] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:26.797660 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.851268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 195/382] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:26.864532 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be836664-bc8b-4f00-8d7d-940594c6c826 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.902633 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249219-051e-4ce1-be23-bea50887fe00 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.941887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:26.942590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.942861 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.943062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.943712 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:26.944129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:26.945663 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:26.960098 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 188/383] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:26.960098 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:26.965744 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be836664-bc8b-4f00-8d7d-940594c6c826 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:26.977926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.002006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.012238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce87d6-eeff-413c-bd2b-c55f312cf2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.013134 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce87d6-eeff-413c-bd2b-c55f312cf2d0 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.013501 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce87d6-eeff-413c-bd2b-c55f312cf2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.013910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce87d6-eeff-413c-bd2b-c55f312cf2d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.027091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce87d6-eeff-413c-bd2b-c55f312cf2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-84ce87d6-eeff-413c-bd2b-c55f312cf2d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:27.032174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:27.033324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 196/384] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:27.039337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce87d6-eeff-413c-bd2b-c55f312cf2d0 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.092283 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1032c2-4605-4948-a90b-4ddd428850fe None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.131317 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.131955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.132233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.132506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.141244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.142774 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.145851 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce87d6-eeff-413c-bd2b-c55f312cf2d0 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:27.155919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:27.156998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 189/385] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:27.157938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.185328 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.185963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.186234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.186501 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.197484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.198959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:27.213806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:27.214942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:27.216691 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:27.216691 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:27.216691 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:27.220099 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 197/386] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:27.220829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.236152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.266334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.266957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1601d4-6183-4d36-bb2c-123ae57597e3 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.301814 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.302456 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.302735 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.303008 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.314612 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.316108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.327470 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0535cd-aa96-42fb-bc6f-556fc9b9d16d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:27.330885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:27.332036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:27.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:27.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:27.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:27.333071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 190/387] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:27.333318 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.365237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.366452 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.367000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.367675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] RBAC: Adding query filter params (name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:27.367974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.369366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.378253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 198/388] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:27.379178 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.443567 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d8a50-6f07-4e95-8013-de95ff12f877 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.466787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.478295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.478924 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.479203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.479473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.483421 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc870a-f995-4cb9-9db2-1d941ee12b17 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.484985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.491502 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.492954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:27.507579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:27.508635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:27.509495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:27.509495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:27.509495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:27.509495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 191/389] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:27.509495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.524534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.525161 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.525418 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.525800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:27.526745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.528171 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.565597 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 199/390] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:27.565597 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.616750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448aff0-b4ac-430e-8258-ea43a3df4f2d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.650548 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.651153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.651431 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.651702 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.652340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:27.652640 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.654091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.665673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 192/391] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:27.666503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.667074 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8201ef-022e-4149-95fe-4b8988eb6d85 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.702965 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.703574 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.703851 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.704112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.704545 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.704830 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:27.705151 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.706725 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.718775 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 200/392] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:27.719813 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.744435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.776560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac4f8e-e920-49fa-a637-8674ad51bc4e None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.811828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.812532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.812758 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.813032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.823927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.824643 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c819-b707-4716-9115-5a1cffac788b None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.825485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:27.840178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:27.841565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:27.842645 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:27.842645 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:27.842645 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:27.845595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 193/393] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:27.846650 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.861228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.861966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.862246 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.862520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.863165 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:27.863461 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.864844 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:27.879815 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 201/394] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:27.880653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.939377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.952631 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493c739-2aa2-4e1c-b79d-527c061c2342 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.966788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.989172 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d5b82-de2a-4fed-8293-85c60c6d8355 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.992538 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.993167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.993474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.993742 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.004666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.006163 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:28.020736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:28.026589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:28.027560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:28.027560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:28.027560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:28.027560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 194/395] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:28.027560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.027876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.027876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.027876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.027876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.036357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.038255 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:28.051947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:28.053017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 202/396] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:28.054100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.135747 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b00b2-b145-4955-8d3c-43f6ef090782 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.163851 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296f78f-1a26-4470-9146-4388a94757ea None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.173380 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.174044 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.174328 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.174590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.182714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.184188 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.187789 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:28.197711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:28.198886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 195/397] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:28.199998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.206903 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.207521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.207800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.208071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.208725 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:28.209025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.210456 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.220904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.224424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 203/398] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.225251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.309140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68c7ad-7200-4695-aaa9-d0117943a3b8 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.330552 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64986e-f752-4377-88c8-06e5c90f4e74 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.345361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a67cf1-4962-4ce0-85be-187ac67ff0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.346006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67cf1-4962-4ce0-85be-187ac67ff0e1 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.346284 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67cf1-4962-4ce0-85be-187ac67ff0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.346552 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67cf1-4962-4ce0-85be-187ac67ff0e1 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.347201 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a67cf1-4962-4ce0-85be-187ac67ff0e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.348634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a67cf1-4962-4ce0-85be-187ac67ff0e1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.367558 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.368161 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.368433 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.368697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.369331 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:28.369656 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.370427 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 196/399] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:28 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:28.371034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.371127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a67cf1-4962-4ce0-85be-187ac67ff0e1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.396566 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 204/400] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.398851 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.440402 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.493927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.496944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a67cf1-4962-4ce0-85be-187ac67ff0e1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.537933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.538555 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.538831 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.539099 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.539806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:28.540128 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.541676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.548576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbf96a-2478-4f1a-8391-62aa3d38a71b None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.563545 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 197/401] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.564609 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.589736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.590735 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.591649 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.591860 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.592573 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:28.592876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.594350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.622027 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 205/402] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.623106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.680144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bafbd1-e4df-40af-baa2-a817eeba87a6 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.698917 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.718995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.719728 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.720010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.720285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.727787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.729252 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.733845 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1308d8e-7a5d-4651-9413-d586de9158be None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:28.742260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:28.743367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:28.744450 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 198/403] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:28.746247 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.757474 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.780115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.781015 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.781290 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.781601 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.790090 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.792188 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:28.807361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:28.808279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:28.810182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 206/404] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:28.810918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.851169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e126a6-8a4c-496d-b542-ea9ed8394eb7 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.888505 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d9686-fe42-4191-9a0f-5483e5461553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.889644 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d9686-fe42-4191-9a0f-5483e5461553 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.890097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d9686-fe42-4191-9a0f-5483e5461553 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.890406 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d9686-fe42-4191-9a0f-5483e5461553 None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/5ccd68808df34afb9bc08db5bdd6afa9/roles/066edc5a61cb425d8ea5a64af7eb6706` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.914800 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d9686-fe42-4191-9a0f-5483e5461553 None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=5ccd68808df34afb9bc08db5bdd6afa9, role_id=066edc5a61cb425d8ea5a64af7eb6706)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.916282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d9686-fe42-4191-9a0f-5483e5461553 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.922843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dade185-5a85-45c3-bdf6-df421d46748a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.937485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 199/405] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:28 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/5ccd68808df34afb9bc08db5bdd6afa9/roles/066edc5a61cb425d8ea5a64af7eb6706 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:28.937485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d9686-fe42-4191-9a0f-5483e5461553 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.962838 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.963649 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.964057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.964423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.979650 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.984672 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.986966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:29.010784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:29.012207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:29.013458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:29.013458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:29.013458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:29.013458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 207/406] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:29.013879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.078790 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d9686-fe42-4191-9a0f-5483e5461553 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.085891 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.121561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.122346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.122766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.123165 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.124064 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:29.124439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.127138 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.155390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 200/407] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.156327 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.167220 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10257edb-f3e8-4125-bdb1-4ed8749a5681 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.209158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.209792 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.210066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.210334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.211024 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:29.211322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.212750 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.231351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 208/408] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.232700 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.273689 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.298730 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda1e39-45af-4c43-ab65-e9ebabf7f493 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.335607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.347325 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c073d-dd21-4e09-9ffa-94c0a0c71a66 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.354098 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.355039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.355559 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.356047 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.360419 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:29.361387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.363414 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.382034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 201/409] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.383230 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.391748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.392481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.392859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.393200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.405074 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.406754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:29.423742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:29.424696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:29.425906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:29.425906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:29.425906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:29.425906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 209/410] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:29.426756 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.516780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d7d22-8c56-4041-b6d0-397ea0d0db2a None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.563597 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be6589-5d37-4c8c-a282-45191bd67364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.564928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be6589-5d37-4c8c-a282-45191bd67364 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.565362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be6589-5d37-4c8c-a282-45191bd67364 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.565802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be6589-5d37-4c8c-a282-45191bd67364 None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/ed5dfb8c97854d37b07ef8474a54e483/roles/066edc5a61cb425d8ea5a64af7eb6706` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.570172 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d9ca4-769d-4b7d-8db8-ebf86613c58e None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.588083 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be6589-5d37-4c8c-a282-45191bd67364 None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=ed5dfb8c97854d37b07ef8474a54e483, role_id=066edc5a61cb425d8ea5a64af7eb6706)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.591950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be6589-5d37-4c8c-a282-45191bd67364 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.595850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.613825 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.614697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.615146 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.615641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.617072 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 202/411] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:29 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/ed5dfb8c97854d37b07ef8474a54e483/roles/066edc5a61cb425d8ea5a64af7eb6706 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:29.619259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be6589-5d37-4c8c-a282-45191bd67364 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.625868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.628113 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:29.641530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:29.642412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:29.643279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:29.643279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:29.643279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:29.643279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:29.643279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:29.643279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:29.643279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:29.643279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:29.645729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 210/412] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:29.654909 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.662507 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.801398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addd063-861e-44e1-9a23-b0c02f1ab981 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.842607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.843633 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.844120 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.844594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.845567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:29.846116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.847785 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.864729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 211/413] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:29.873556 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.891883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be6589-5d37-4c8c-a282-45191bd67364 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.951198 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.952174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.952658 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.953170 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.954930 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:29.955460 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.957036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.970544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 203/414] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.978498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:30.008462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:30.070511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:30.086459 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d872e-1740-47d6-8858-5d8dad853725 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:30.123042 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa9a6-8ad6-4ef2-beef-3485239bc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:30.123973 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa9a6-8ad6-4ef2-beef-3485239bc24a None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:30.124254 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa9a6-8ad6-4ef2-beef-3485239bc24a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:30.124527 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa9a6-8ad6-4ef2-beef-3485239bc24a None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/f1e86459f94d403bbec3b2f4dc56c458/roles/066edc5a61cb425d8ea5a64af7eb6706` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:30.142676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfa9a6-8ad6-4ef2-beef-3485239bc24a None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=f1e86459f94d403bbec3b2f4dc56c458, role_id=066edc5a61cb425d8ea5a64af7eb6706)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:30.144420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfa9a6-8ad6-4ef2-beef-3485239bc24a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:30.162538 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 212/415] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:29 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/f1e86459f94d403bbec3b2f4dc56c458/roles/066edc5a61cb425d8ea5a64af7eb6706 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:30.186501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128452d-2fa9-405f-b9ba-2c9c3f56f387 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:30.255714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:30.256651 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:30.257077 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:30.257518 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:30.271690 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:30.273469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:30.295724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:30.296794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:30.297840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:30.297840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:30.297840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:30.297840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:30.297840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:30.297840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:30.297840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:30.297840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:30.299665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 204/416] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:30.305754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa9a6-8ad6-4ef2-beef-3485239bc24a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:30.439012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa9a6-8ad6-4ef2-beef-3485239bc24a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:30.454938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:30.490393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02edc29-370f-4f9d-8b5b-aa6ba82b1f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:30.491636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02edc29-370f-4f9d-8b5b-aa6ba82b1f6a None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:30.492187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02edc29-370f-4f9d-8b5b-aa6ba82b1f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:30.492666 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02edc29-370f-4f9d-8b5b-aa6ba82b1f6a None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:30.494000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02edc29-370f-4f9d-8b5b-aa6ba82b1f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:30.494536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02edc29-370f-4f9d-8b5b-aa6ba82b1f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:30.497043 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02edc29-370f-4f9d-8b5b-aa6ba82b1f6a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:30.517167 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 213/417] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:30.526187 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:30.757033 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25df6dc-356f-4164-ac0f-008036becf99 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:30.783863 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:30.824725 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b7bff-c2e1-42c5-a05a-56809c31f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:30.826938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b7bff-c2e1-42c5-a05a-56809c31f6d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:30.827395 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b7bff-c2e1-42c5-a05a-56809c31f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:30.827849 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b7bff-c2e1-42c5-a05a-56809c31f6d7 None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/2facaae2a22448bcb52811b9cee5f0fd/roles/066edc5a61cb425d8ea5a64af7eb6706` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:30.864794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b7bff-c2e1-42c5-a05a-56809c31f6d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=2facaae2a22448bcb52811b9cee5f0fd, role_id=066edc5a61cb425d8ea5a64af7eb6706)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:30.867773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b7bff-c2e1-42c5-a05a-56809c31f6d7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:30.905603 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 205/418] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:30 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/2facaae2a22448bcb52811b9cee5f0fd/roles/066edc5a61cb425d8ea5a64af7eb6706 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:31.033981 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c575-00f6-4686-bf1c-1ae70a1c943f None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:31.035386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c575-00f6-4686-bf1c-1ae70a1c943f None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:31.036119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c575-00f6-4686-bf1c-1ae70a1c943f None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:31.039069 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 214/419] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:31.048725 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3362-78b3-4cab-a6ff-cf2ff0205ccb None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:31.049633 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3362-78b3-4cab-a6ff-cf2ff0205ccb None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:31.050318 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3362-78b3-4cab-a6ff-cf2ff0205ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:31.079755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-1a9c3362-78b3-4cab-a6ff-cf2ff0205ccb None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:31.082050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-1a9c3362-78b3-4cab-a6ff-cf2ff0205ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:31.226552 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 206/420] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:31.655527 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92c575-00f6-4686-bf1c-1ae70a1c943f None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:31.887205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92c575-00f6-4686-bf1c-1ae70a1c943f None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:31.932207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975b3e2-fb75-4549-bb80-c073f70ba98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:31.932760 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975b3e2-fb75-4549-bb80-c073f70ba98b None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:31.933043 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975b3e2-fb75-4549-bb80-c073f70ba98b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:31.933311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975b3e2-fb75-4549-bb80-c073f70ba98b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:31.954736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975b3e2-fb75-4549-bb80-c073f70ba98b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-c975b3e2-fb75-4549-bb80-c073f70ba98b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:31.960251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:31.961211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:31.962046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 215/421] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:31.972435 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c3362-78b3-4cab-a6ff-cf2ff0205ccb None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:32.110947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:32.120375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c3362-78b3-4cab-a6ff-cf2ff0205ccb None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:32.173003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6e103-1845-42ff-8096-161a8fbbeec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:32.173654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e103-1845-42ff-8096-161a8fbbeec1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.173933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e103-1845-42ff-8096-161a8fbbeec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.174208 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e103-1845-42ff-8096-161a8fbbeec1 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.174884 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6e103-1845-42ff-8096-161a8fbbeec1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:32.175186 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6e103-1845-42ff-8096-161a8fbbeec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:32.176549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6e103-1845-42ff-8096-161a8fbbeec1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:32.185930 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 207/422] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:32.192411 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975b3e2-fb75-4549-bb80-c073f70ba98b None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:32.220718 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2c90-ad26-4f9a-a200-208b63215562 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.221071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2c90-ad26-4f9a-a200-208b63215562 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.221271 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2c90-ad26-4f9a-a200-208b63215562 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.222736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 208/423] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:32.239547 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:32.248258 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4fdc0-3b32-454d-ad17-41fbe42f6b35 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.248659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4fdc0-3b32-454d-ad17-41fbe42f6b35 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.248814 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4fdc0-3b32-454d-ad17-41fbe42f6b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.285544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-14d4fdc0-3b32-454d-ad17-41fbe42f6b35 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:32.292022 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-14d4fdc0-3b32-454d-ad17-41fbe42f6b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:32.400548 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975b3e2-fb75-4549-bb80-c073f70ba98b None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:32.407803 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 209/424] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:32.423882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eeeb6-895e-4636-8165-16ddc1f989cf None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.424291 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eeeb6-895e-4636-8165-16ddc1f989cf None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.424445 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eeeb6-895e-4636-8165-16ddc1f989cf None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.425806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 210/425] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:32.439798 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8a55-2c12-4924-ad60-f4eeb4ef937b None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.440232 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8a55-2c12-4924-ad60-f4eeb4ef937b None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.440705 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8a55-2c12-4924-ad60-f4eeb4ef937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.493122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:32.494192 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.494674 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.495142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.498083 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-cfdc8a55-2c12-4924-ad60-f4eeb4ef937b None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:32.502267 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-cfdc8a55-2c12-4924-ad60-f4eeb4ef937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:32.537885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:32.540579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:32.586758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:32.588513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:32.590235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:32.590235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:32.590235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:32.598919 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 216/426] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:32.602622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:32.694931 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 211/427] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:32.719021 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8a55-2c12-4924-ad60-f4eeb4ef937b None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:32.738232 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:32.771062 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:32.810343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45044afa-26c2-43f0-998e-644ab85d3645 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:32.862267 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:32.863195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8a55-2c12-4924-ad60-f4eeb4ef937b None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:32.863414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.863858 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.864314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.865149 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:32.865658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:32.867488 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:32.884057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 217/428] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:32.898919 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:32.905088 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332f08-8f1c-4619-812f-f88e1d22e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:32.905775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332f08-8f1c-4619-812f-f88e1d22e69b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.906051 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332f08-8f1c-4619-812f-f88e1d22e69b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.906322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc332f08-8f1c-4619-812f-f88e1d22e69b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.921463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc332f08-8f1c-4619-812f-f88e1d22e69b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-bc332f08-8f1c-4619-812f-f88e1d22e69b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:32.923053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:32.923928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:32.924722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 212/429] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:32.930182 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332f08-8f1c-4619-812f-f88e1d22e69b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.024009 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.042370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc332f08-8f1c-4619-812f-f88e1d22e69b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.082554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.083187 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.083465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.083739 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.084529 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:33.084834 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.086482 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.101286 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd1ce1-431c-43a6-be5f-b1adee469b06 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.101915 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 213/430] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:33.102943 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.150417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.151428 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.151700 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.151967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] PATH_INFO: `/v3/users/swift` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.161929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.164012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:33.182094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:33.183116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:35:33.184002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:33.186501 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 218/431] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:33.187605 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.193619 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.220568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401151-766f-4ba3-9699-2d0d076f6667 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.262341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc690-c56b-47ac-a650-5871e6c8fe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.263066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc690-c56b-47ac-a650-5871e6c8fe08 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.263415 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc690-c56b-47ac-a650-5871e6c8fe08 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.263695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cc690-c56b-47ac-a650-5871e6c8fe08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.271197 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.275474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cc690-c56b-47ac-a650-5871e6c8fe08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-754cc690-c56b-47ac-a650-5871e6c8fe08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:33.282075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:33.282994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:33.283851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 214/432] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:33.285331 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc690-c56b-47ac-a650-5871e6c8fe08 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.309159 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55329c5-ffd0-41cb-aa6a-fcaa1c915fde None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.347071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c20cf5-b632-4fe5-bcc6-e071203f32a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.347705 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c20cf5-b632-4fe5-bcc6-e071203f32a7 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.347997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c20cf5-b632-4fe5-bcc6-e071203f32a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.348241 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c20cf5-b632-4fe5-bcc6-e071203f32a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.360087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c20cf5-b632-4fe5-bcc6-e071203f32a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.362283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c20cf5-b632-4fe5-bcc6-e071203f32a7 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-89c20cf5-b632-4fe5-bcc6-e071203f32a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:33.384748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:33.386106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 219/433] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf77d-b213-403a-8273-b298899bdde2 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf77d-b213-403a-8273-b298899bdde2 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf77d-b213-403a-8273-b298899bdde2 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 220/434] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:33.387305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaf77d-b213-403a-8273-b298899bdde2 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.412545 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cc690-c56b-47ac-a650-5871e6c8fe08 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.449925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.450689 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.450970 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.451246 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.451980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:33.452286 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.453772 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.473882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 215/435] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:33.474732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.502355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaf77d-b213-403a-8273-b298899bdde2 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.539000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd1754-bd64-4e19-ad6f-d4bdb13aec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.539496 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd1754-bd64-4e19-ad6f-d4bdb13aec10 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.539879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd1754-bd64-4e19-ad6f-d4bdb13aec10 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.540056 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd1754-bd64-4e19-ad6f-d4bdb13aec10 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.540692 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd1754-bd64-4e19-ad6f-d4bdb13aec10 None admin] RBAC: Adding query filter params (name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:33.540986 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd1754-bd64-4e19-ad6f-d4bdb13aec10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.541649 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.542394 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd1754-bd64-4e19-ad6f-d4bdb13aec10 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.551785 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 221/436] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:33.553030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1d72-4798-4dce-bab2-ece4c0db10af None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.553316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1d72-4798-4dce-bab2-ece4c0db10af None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.553624 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1d72-4798-4dce-bab2-ece4c0db10af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.574183 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-0c2f1d72-4798-4dce-bab2-ece4c0db10af None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:33.576384 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-0c2f1d72-4798-4dce-bab2-ece4c0db10af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:33.600937 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaa74f-3868-4985-8b58-72eceded7e23 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.639211 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.639837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.640148 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.640424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.641073 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:33.641375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.642781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.651972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 222/437] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:33.652729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f1d72-4798-4dce-bab2-ece4c0db10af None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.661137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 216/438] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:33.662354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.739782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.789149 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70596de5-3d6c-4f7b-a7c3-d070dc6b8f02 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.804223 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f1d72-4798-4dce-bab2-ece4c0db10af None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.810044 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.834105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.834755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.835192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.835404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.844476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.845520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.845997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.846462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.848406 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.850148 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.859169 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.860992 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:33.867882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:33.868887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:33.874782 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:33.874782 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:33.874782 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:33.874782 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 217/439] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:33.874782 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:33.887071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:33.888582 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:33.889632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:33.889632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:33.889632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:33.893531 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 223/440] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:33.894667 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.001914 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c5dd4-29ae-4419-858d-0ce5a7e1008c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.020071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.023489 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6293d-2d9f-4257-8c42-df5d0cb4bf21 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.043427 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.044191 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.044393 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.044840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.052775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.054268 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.061842 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.062348 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.062626 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.062898 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.063546 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:34.063854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.065228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:34.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:34.068034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:34.068979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 218/441] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:34.069566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.088968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 224/442] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:34.088968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.107184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.191278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974ddeb-1e60-4c0a-8f26-5159fc34be29 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.198605 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bda67e-bcde-48e4-80ee-1d70316d9371 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.238385 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b12e-6e0c-4d5e-a030-2791dda71ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.239044 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b12e-6e0c-4d5e-a030-2791dda71ca8 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.239324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b12e-6e0c-4d5e-a030-2791dda71ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.239594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b12e-6e0c-4d5e-a030-2791dda71ca8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.244442 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.245115 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.245389 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.245695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.246342 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:34.246639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.248527 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.252050 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b12e-6e0c-4d5e-a030-2791dda71ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-8118b12e-6e0c-4d5e-a030-2791dda71ca8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:34.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:34.257910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:34.258739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 225/443] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:34.259603 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b12e-6e0c-4d5e-a030-2791dda71ca8 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.267397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 219/444] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:34.268473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.286882 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.358528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.368543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b12e-6e0c-4d5e-a030-2791dda71ca8 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.371344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbef8b-34ce-417f-8096-0a3d441a8f46 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.403117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b471f89-22e6-42c3-acae-9f7db4f43e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.403727 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b471f89-22e6-42c3-acae-9f7db4f43e21 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.404010 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b471f89-22e6-42c3-acae-9f7db4f43e21 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.404280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b471f89-22e6-42c3-acae-9f7db4f43e21 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.405003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b471f89-22e6-42c3-acae-9f7db4f43e21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:34.405303 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b471f89-22e6-42c3-acae-9f7db4f43e21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.406539 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.406767 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b471f89-22e6-42c3-acae-9f7db4f43e21 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.407171 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.407451 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.407726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] PATH_INFO: `/v3/users/glance` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.414899 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.416337 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.424650 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 226/445] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:34.425942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3174-c095-4ac1-ad3b-a44db7322316 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.426187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3174-c095-4ac1-ad3b-a44db7322316 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.426456 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3174-c095-4ac1-ad3b-a44db7322316 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.429480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 227/446] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:34.429617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:34.432691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 08:35:34.433642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:34.434142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f3174-c095-4ac1-ad3b-a44db7322316 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.434224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 220/447] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:34.434224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.523627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.547852 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60399e4e-5bcf-4898-87e9-26a0c401ccdd None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.548367 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f3174-c095-4ac1-ad3b-a44db7322316 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.588641 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04ac8f-6b28-420f-ac48-9df3c483a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.589167 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.589287 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ac8f-6b28-420f-ac48-9df3c483a806 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.589590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ac8f-6b28-420f-ac48-9df3c483a806 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.589819 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.589987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ac8f-6b28-420f-ac48-9df3c483a806 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.590117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.590355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.591100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] RBAC: Adding query filter params (name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:34.592022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.592939 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.597935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ac8f-6b28-420f-ac48-9df3c483a806 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.599433 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04ac8f-6b28-420f-ac48-9df3c483a806 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.602333 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 228/448] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:34.603223 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-4d04ac8f-6b28-420f-ac48-9df3c483a806 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:34.613458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:34.614376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:34.615249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 221/449] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:34.616166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829f2e-cd4c-4dce-9797-97811fd191fa None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.616519 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829f2e-cd4c-4dce-9797-97811fd191fa None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.616751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829f2e-cd4c-4dce-9797-97811fd191fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.636047 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-98829f2e-cd4c-4dce-9797-97811fd191fa None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:34.637290 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-98829f2e-cd4c-4dce-9797-97811fd191fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:34.640206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.733005 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 222/450] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:34.734248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98829f2e-cd4c-4dce-9797-97811fd191fa None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.753677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104c0e-a687-43de-85e8-10c536b0a899 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.791129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa90d5-c220-46a4-bd8f-063ab40c648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.791740 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa90d5-c220-46a4-bd8f-063ab40c648d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.792012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa90d5-c220-46a4-bd8f-063ab40c648d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.792277 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa90d5-c220-46a4-bd8f-063ab40c648d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.805332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.879699 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98829f2e-cd4c-4dce-9797-97811fd191fa None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.880843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa90d5-c220-46a4-bd8f-063ab40c648d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.882485 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa90d5-c220-46a4-bd8f-063ab40c648d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.925354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.926235 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.926686 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.927108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.927992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:34.928294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.929769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.938775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.951166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 223/451] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:34.952092 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.995733 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 229/452] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:34.996586 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa90d5-c220-46a4-bd8f-063ab40c648d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.041212 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.066079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc93c6-6c9a-4c64-8aa1-517d4375c820 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.098741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa90d5-c220-46a4-bd8f-063ab40c648d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.100443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.101075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.101349 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.101651 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.111883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.113330 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:35.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:35.129195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:35.130314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:35.130314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:35.130314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:35.130314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 224/453] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:35.130314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.135661 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.136267 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.136542 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.136806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.137521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:35.138370 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.139780 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.151331 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 230/454] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:35.152116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.184107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.237253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c23e4-18ac-422e-a47b-ae8b6ae85a91 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.249638 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.252832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942677d8-eca2-449d-a936-b4d39e85b433 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.272995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5256-075c-439e-93ab-856869f800b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.273629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5256-075c-439e-93ab-856869f800b4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.273908 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5256-075c-439e-93ab-856869f800b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.274180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5256-075c-439e-93ab-856869f800b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.291247 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.291867 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.292140 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.292410 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.303672 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.305107 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:35.319174 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:35.320082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:35.321006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:35.321006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:35.321006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:35.321006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 231/455] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:35.321478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.351754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb5256-075c-439e-93ab-856869f800b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.353201 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb5256-075c-439e-93ab-856869f800b4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.407238 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.429822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d22ad-f114-48e1-b9ec-01464193ada0 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.461864 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 225/456] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:35.462714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5256-075c-439e-93ab-856869f800b4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.465205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a34fc-83eb-45f9-8ce2-651cc9b33eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.466362 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a34fc-83eb-45f9-8ce2-651cc9b33eba None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.466636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a34fc-83eb-45f9-8ce2-651cc9b33eba None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.467112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a34fc-83eb-45f9-8ce2-651cc9b33eba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.477490 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a34fc-83eb-45f9-8ce2-651cc9b33eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-317a34fc-83eb-45f9-8ce2-651cc9b33eba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:35.483702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:35.484940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 232/457] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:35.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a34fc-83eb-45f9-8ce2-651cc9b33eba None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.505581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.583487 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5256-075c-439e-93ab-856869f800b4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.596990 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a34fc-83eb-45f9-8ce2-651cc9b33eba None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.623903 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.624524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.624802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.625079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.625768 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:35.626067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.627486 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.635996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac669f58-b24b-4a1b-b2ee-70833d724c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.636669 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac669f58-b24b-4a1b-b2ee-70833d724c80 None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.636939 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac669f58-b24b-4a1b-b2ee-70833d724c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.637205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac669f58-b24b-4a1b-b2ee-70833d724c80 None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/bf84d9f0ae734f04aa277f8624b7bd45/roles/066edc5a61cb425d8ea5a64af7eb6706` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.641430 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 226/458] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:35.642514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.654820 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac669f58-b24b-4a1b-b2ee-70833d724c80 None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=bf84d9f0ae734f04aa277f8624b7bd45, role_id=066edc5a61cb425d8ea5a64af7eb6706)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.656281 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac669f58-b24b-4a1b-b2ee-70833d724c80 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.657398 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.670140 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 233/459] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:35 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/bf84d9f0ae734f04aa277f8624b7bd45/roles/066edc5a61cb425d8ea5a64af7eb6706 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:35.670991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac669f58-b24b-4a1b-b2ee-70833d724c80 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.762290 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.771444 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf857f-9174-41e4-8e8c-81be1cc7da76 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.809874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac669f58-b24b-4a1b-b2ee-70833d724c80 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.815687 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.816348 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.816619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.816887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.817620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:35.818104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.820127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.836585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 227/460] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:35.837301 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.872213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.873335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.873646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.874178 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.898752 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.901643 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.927832 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:35.932837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:35.935063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:35.936583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:35.936583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:35.936583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:35.936583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 234/461] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:35.936583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.986433 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e712d1-d620-4f64-b539-9db035209eba None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.032056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.032668 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.033068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.033334 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.034113 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:36.034484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.035812 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.051637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 228/462] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:36.052646 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.126489 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf260480-571c-44af-8d55-f757ef245c23 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.147300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.175475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.176123 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.176402 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.176667 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.186409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.187945 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.192307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9145ca-e7fb-41d7-b41f-ffe3fe89fd2f None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:36.201321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:36.202935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:35:36.204343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:36.206874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 235/463] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:36.208670 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.244457 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.253880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.254838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.255278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.255673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.267913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.270400 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:36.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:36.289212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 229/464] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:36.299137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.376666 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1b6a-66a6-4251-aca8-e1cb411d5f41 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.440245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.441192 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.441732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.442232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.443423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:36.443964 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.446618 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.473844 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 236/465] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:36.473844 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.486999 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545d41d-ac37-4175-9281-49830bfa188a None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.536889 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.557008 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.558002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.558447 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.558899 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.579706 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.582195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:36.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:36.610750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:36.611672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:36.611672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:36.611672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:36.613948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 230/466] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:36.615696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.635139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d196-9513-4260-a116-0da3140ca713 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.695101 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.701960 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.702592 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.702857 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.703134 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.703960 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:36.704480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.706734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.738746 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 237/467] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:36.739938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.803226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a1c8-e7e9-4eeb-a939-cdb173fd65c9 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.851791 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.852421 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.852685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.852959 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.853717 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:36.854023 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.855528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.880730 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 231/468] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:36.880730 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.924236 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.940398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e414ca5-2885-4da1-a5f8-13ff5a894772 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.012519 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.014511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.014937 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.015351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.027652 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.031580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.038296 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735d591-818f-4a34-97d2-f66e36c6526d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.040620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:37.054914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:37.055968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:37.056977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:37.056977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:37.056977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:37.056977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:37.056977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:37.056977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:37.056977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:37.056977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:37.057555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 238/469] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:37.058659 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.100157 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.101316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.101882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.102343 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.103501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:37.104017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.106679 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.137335 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 232/470] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:37.139722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.230668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d43fbd-4d78-4858-840e-cb0b4bbbee32 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.295728 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc379d81-199f-4c87-8e9f-c2f1cb9718b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.296658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc379d81-199f-4c87-8e9f-c2f1cb9718b2 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.296932 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc379d81-199f-4c87-8e9f-c2f1cb9718b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.297201 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc379d81-199f-4c87-8e9f-c2f1cb9718b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.322912 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.336982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0421-2582-420a-97e7-fd29c20bad77 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.383992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.385372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.386037 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.386968 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.389685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] RBAC: Adding query filter params (role.id=066edc5a61cb425d8ea5a64af7eb6706, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=5ccd68808df34afb9bc08db5bdd6afa9) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:37.390226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.392934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.409759 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 233/471] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/role_assignments?user.id=5ccd68808df34afb9bc08db5bdd6afa9&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=066edc5a61cb425d8ea5a64af7eb6706 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:37.410056 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc379d81-199f-4c87-8e9f-c2f1cb9718b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.410056 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc379d81-199f-4c87-8e9f-c2f1cb9718b2 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.410891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.471287 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.630132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c4404-bf40-4f95-9e0d-84e138b7dba1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.639571 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 239/472] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:37.641010 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc379d81-199f-4c87-8e9f-c2f1cb9718b2 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.715752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.715752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.717696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.717696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.718752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:37.719135 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.720746 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.749473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 234/473] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:37.749473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.758316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.857025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc379d81-199f-4c87-8e9f-c2f1cb9718b2 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.924826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.925969 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.928651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.929521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.930435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.947122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.950344 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.957755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672214f-b71d-4763-ab0a-55dedc7d523a None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:37.989231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:37.991025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 08:35:37.994085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:37.999975 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 240/474] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:38.002067 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.041598 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.042689 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.043153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.043608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.067015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.069512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:38.105272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:38.107375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:38.109732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:38.109732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:38.109732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:38.109732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 235/475] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:38.110598 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.230400 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0348525-37ff-481d-9e46-667b739b9322 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.256734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.278492 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333056-89fb-4aff-884e-7d148c4182d1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.298232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157310-6bd5-496a-965a-671a33585422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.298962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157310-6bd5-496a-965a-671a33585422 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.299241 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157310-6bd5-496a-965a-671a33585422 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.299506 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157310-6bd5-496a-965a-671a33585422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.300264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157310-6bd5-496a-965a-671a33585422 None admin] RBAC: Adding query filter params (role.id=066edc5a61cb425d8ea5a64af7eb6706, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=ed5dfb8c97854d37b07ef8474a54e483) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:38.300561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157310-6bd5-496a-965a-671a33585422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.302067 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157310-6bd5-496a-965a-671a33585422 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.309613 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 241/476] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/role_assignments?user.id=ed5dfb8c97854d37b07ef8474a54e483&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=066edc5a61cb425d8ea5a64af7eb6706 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:38.310930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157310-6bd5-496a-965a-671a33585422 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.331893 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9c770-dbab-4db8-904a-10a8be3e7c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.332960 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9c770-dbab-4db8-904a-10a8be3e7c8a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.333472 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9c770-dbab-4db8-904a-10a8be3e7c8a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.333945 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9c770-dbab-4db8-904a-10a8be3e7c8a None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.335155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9c770-dbab-4db8-904a-10a8be3e7c8a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:38.335987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9c770-dbab-4db8-904a-10a8be3e7c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.337715 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9c770-dbab-4db8-904a-10a8be3e7c8a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.353188 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.371499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 236/477] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:38.373563 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a22dd-14ce-42a4-abd3-8a6fc8238d9c None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.374048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a22dd-14ce-42a4-abd3-8a6fc8238d9c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.374492 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a22dd-14ce-42a4-abd3-8a6fc8238d9c None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.376211 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 237/478] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:38.377477 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a22dd-14ce-42a4-abd3-8a6fc8238d9c None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.454154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157310-6bd5-496a-965a-671a33585422 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.505193 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86966147-a94d-4c5e-909d-65f0c4a52558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.505815 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966147-a94d-4c5e-909d-65f0c4a52558 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.506219 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966147-a94d-4c5e-909d-65f0c4a52558 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.506587 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86966147-a94d-4c5e-909d-65f0c4a52558 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.507527 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966147-a94d-4c5e-909d-65f0c4a52558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:38.507835 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966147-a94d-4c5e-909d-65f0c4a52558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.510385 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86966147-a94d-4c5e-909d-65f0c4a52558 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.517475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a22dd-14ce-42a4-abd3-8a6fc8238d9c None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.530219 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 242/479] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:38.532026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41395-edd4-43fb-9ded-593f56ba74a5 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.532302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41395-edd4-43fb-9ded-593f56ba74a5 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.532569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41395-edd4-43fb-9ded-593f56ba74a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.559101 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-6bc41395-edd4-43fb-9ded-593f56ba74a5 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:38.561102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6bc41395-edd4-43fb-9ded-593f56ba74a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:38.566988 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf26d-8ceb-4145-b155-dad884f6c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.567713 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf26d-8ceb-4145-b155-dad884f6c233 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.568081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf26d-8ceb-4145-b155-dad884f6c233 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.568421 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf26d-8ceb-4145-b155-dad884f6c233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.606831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.660748 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.672458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 243/480] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:38.674377 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41395-edd4-43fb-9ded-593f56ba74a5 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.683325 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf26d-8ceb-4145-b155-dad884f6c233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.685764 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf26d-8ceb-4145-b155-dad884f6c233 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.893704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41395-edd4-43fb-9ded-593f56ba74a5 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.929008 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 238/481] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:38.936083 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf26d-8ceb-4145-b155-dad884f6c233 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.997406 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.998119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.998392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.998658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.008000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.009719 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:39.024993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:39.026634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 244/482] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:39.028896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.068419 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:39.162495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:39.176344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf26d-8ceb-4145-b155-dad884f6c233 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.178937 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fdf95-8b1a-42b3-acd4-e8683f778589 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.229302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d8c15-ae57-43bc-a637-4f5a6c40a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.230649 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8c15-ae57-43bc-a637-4f5a6c40a23f None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.231312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8c15-ae57-43bc-a637-4f5a6c40a23f None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.232111 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d8c15-ae57-43bc-a637-4f5a6c40a23f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.236997 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.237680 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.237956 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.238223 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.251110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.252598 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.256442 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d8c15-ae57-43bc-a637-4f5a6c40a23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-8c0d8c15-ae57-43bc-a637-4f5a6c40a23f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:39.267206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:39.268888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:39.270379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:39.272880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:39.276140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:39.279967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:39.279967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:39.279967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:39.279967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 239/483] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:39.279967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.283445 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 245/484] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:39.285142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d8c15-ae57-43bc-a637-4f5a6c40a23f None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.396589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4dad4-2ce2-47bd-b96b-f233b7a2dd94 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.433992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.434507 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.435367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.435610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.436367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:39.436674 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.438174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.453027 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 240/485] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:39.453933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.462306 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:39.467204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:39.494887 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d8c15-ae57-43bc-a637-4f5a6c40a23f None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.568760 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.569874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.570166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c3c0-8a84-4207-8088-6fa619b9bd64 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.570426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.570838 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.572202 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:39.572888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.576288 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.602764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 246/486] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:39.604299 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.615456 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.616077 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.621469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.621469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.621469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:39.621469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.621469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.628605 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 241/487] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:39.629484 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.713645 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:39.753324 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c33709-c92d-4f67-b8d5-5c3135b77fa8 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.809380 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.810941 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.812142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.812974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.817883 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac943833-5aed-4c19-94c3-747da8232d16 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.829534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.834247 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.862391 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.863105 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.863440 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.863772 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:39.864241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:39.865709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:39.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:39.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:39.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:39.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:39.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:39.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:39.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:39.868480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:39.869678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] RBAC: Adding query filter params (role.id=066edc5a61cb425d8ea5a64af7eb6706, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=f1e86459f94d403bbec3b2f4dc56c458) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:39.869678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.870043 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 242/488] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:39.870043 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.877559 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.885935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 247/489] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/role_assignments?user.id=f1e86459f94d403bbec3b2f4dc56c458&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=066edc5a61cb425d8ea5a64af7eb6706 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.920188 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:40.107592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf57819-18d1-484f-8aab-710190361125 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:40.179027 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:40.192653 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:40.193351 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:40.195294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:40.195602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:40.215670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:40.219025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:40.226062 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e11d0-bdb4-499e-9147-d29e405a4b59 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:40.237397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:40.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:40.240928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:40.240928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:40.240928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:40.240928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 243/490] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:40.245283 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:40.338315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:40.341350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:40.342207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:40.342953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:40.347558 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:40.348547 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:40.351735 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:40.393654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9c140-e259-496d-aca6-14345ced00a0 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:40.395626 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 248/491] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:40.402675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:40.436192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:40.437050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:40.437311 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:40.437703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:40.438464 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:40.438863 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:40.445468 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:40.454587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 244/492] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:40.465494 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:40.507373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:40.599547 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:40.640200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79053e-15af-4110-a715-b423a99ae060 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:40.678557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a07db-9d7d-45d5-b106-8685060f64a1 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:40.746476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:40.747877 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:40.748151 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:40.748416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:40.761683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:40.763223 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:40.764003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:40.764758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:40.766967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] RBAC: Adding query filter params (role.id=066edc5a61cb425d8ea5a64af7eb6706, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=2facaae2a22448bcb52811b9cee5f0fd) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:40.767146 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:40.768138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:40.768549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:40.771832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:40.787641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 249/493] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:40 2022] GET /identity/v3/role_assignments?user.id=2facaae2a22448bcb52811b9cee5f0fd&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=066edc5a61cb425d8ea5a64af7eb6706 => generated 608 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:40.798906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:40.800754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:40.803694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 245/494] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:40.807619 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:41.088236 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ca2c-1767-46e1-bb45-781bd49e1b98 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:41.164312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc215f-9a82-412b-9b68-1ae456473c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:41.165969 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc215f-9a82-412b-9b68-1ae456473c0e None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.166856 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc215f-9a82-412b-9b68-1ae456473c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.167671 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc215f-9a82-412b-9b68-1ae456473c0e None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.169995 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc215f-9a82-412b-9b68-1ae456473c0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:41.170899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc215f-9a82-412b-9b68-1ae456473c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:41.174026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc215f-9a82-412b-9b68-1ae456473c0e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:41.177707 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:41.220250 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 250/495] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 24 08:35:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:41.227050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:41.400186 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2216-e309-495b-98da-60b22faaf3cb None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:41.401886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:41.456392 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d6259-77b9-4eb2-bf99-045bdb147fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:41.457280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d6259-77b9-4eb2-bf99-045bdb147fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.457280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d6259-77b9-4eb2-bf99-045bdb147fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.457586 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d6259-77b9-4eb2-bf99-045bdb147fa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.506460 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415fe69-a509-4080-bba5-da5aff818d28 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.506884 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415fe69-a509-4080-bba5-da5aff818d28 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.507330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415fe69-a509-4080-bba5-da5aff818d28 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.516418 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 251/496] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:41.519113 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752c8f-5f85-45fb-9650-94c03738c932 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.519565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752c8f-5f85-45fb-9650-94c03738c932 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.520007 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752c8f-5f85-45fb-9650-94c03738c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.565925 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-ff752c8f-5f85-45fb-9650-94c03738c932 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:41.567237 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d6259-77b9-4eb2-bf99-045bdb147fa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:41.568724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d6259-77b9-4eb2-bf99-045bdb147fa9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:41.571638 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ff752c8f-5f85-45fb-9650-94c03738c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:41.726064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 252/497] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:41.810285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 246/498] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:41.819288 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff752c8f-5f85-45fb-9650-94c03738c932 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.077260 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff752c8f-5f85-45fb-9650-94c03738c932 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.137207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.164497 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.165561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.166027 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.166476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.186715 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:42.189257 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:42.217873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:42.219678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:42.221350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:42.221350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:42.221350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:42.221350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 253/499] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:42.228850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d6259-77b9-4eb2-bf99-045bdb147fa9 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.232376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.341923 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.443037 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d6259-77b9-4eb2-bf99-045bdb147fa9 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.512205 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.513938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.513938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.514428 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.516243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:42.516778 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:42.519585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:42.556801 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 247/500] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:42.574585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.655314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9cbd4-67bc-4c08-89c5-9cd5c8d9f754 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.729990 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95ae60-9e15-4567-8fa3-4b2866e84ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.733417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95ae60-9e15-4567-8fa3-4b2866e84ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.734294 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95ae60-9e15-4567-8fa3-4b2866e84ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.735130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95ae60-9e15-4567-8fa3-4b2866e84ed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.757858 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95ae60-9e15-4567-8fa3-4b2866e84ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-9c95ae60-9e15-4567-8fa3-4b2866e84ed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:42.769369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:42.771112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:42.773228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:42.779947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 254/501] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:42.789481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95ae60-9e15-4567-8fa3-4b2866e84ed5 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.794914 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.885505 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c861a7-d93f-40c1-bbcb-53a60f4abc2d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.909125 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.995853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc568dc-156c-4e87-b401-bdd46473dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.996910 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc568dc-156c-4e87-b401-bdd46473dd45 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.998054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc568dc-156c-4e87-b401-bdd46473dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.998535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc568dc-156c-4e87-b401-bdd46473dd45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.011638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc568dc-156c-4e87-b401-bdd46473dd45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.014548 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc568dc-156c-4e87-b401-bdd46473dd45 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-afc568dc-156c-4e87-b401-bdd46473dd45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:43.038259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:43.040029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:43.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:43.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:43.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:43.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:43.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:43.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:43.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:43.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:43.046438 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 248/502] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:43.048890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c08a0-2bbb-4b91-b7c4-a09c4ef00ca5 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.049385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c08a0-2bbb-4b91-b7c4-a09c4ef00ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.049895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c08a0-2bbb-4b91-b7c4-a09c4ef00ca5 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.052410 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 249/503] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:43.057827 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c08a0-2bbb-4b91-b7c4-a09c4ef00ca5 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.062170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95ae60-9e15-4567-8fa3-4b2866e84ed5 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.131443 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50784fe-f04c-4a97-b403-980e621d8ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.133039 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50784fe-f04c-4a97-b403-980e621d8ff9 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.133877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50784fe-f04c-4a97-b403-980e621d8ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.134686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50784fe-f04c-4a97-b403-980e621d8ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.136195 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50784fe-f04c-4a97-b403-980e621d8ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:43.137040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50784fe-f04c-4a97-b403-980e621d8ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.140329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50784fe-f04c-4a97-b403-980e621d8ff9 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.159030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 255/504] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.162095 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8ca3c-528b-4c30-96ba-13e81e00aa46 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.162962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8ca3c-528b-4c30-96ba-13e81e00aa46 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.163735 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8ca3c-528b-4c30-96ba-13e81e00aa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.198660 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-59f8ca3c-528b-4c30-96ba-13e81e00aa46 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:43.201611 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-59f8ca3c-528b-4c30-96ba-13e81e00aa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:43.264250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c08a0-2bbb-4b91-b7c4-a09c4ef00ca5 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.308547 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.335662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.336710 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.337141 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.337641 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.338766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:43.339266 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.342511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 256/505] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:43.343183 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.344622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8ca3c-528b-4c30-96ba-13e81e00aa46 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.369496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 250/506] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.387202 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.434059 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.656847 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8ca3c-528b-4c30-96ba-13e81e00aa46 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.663210 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8db7de-71e0-41b8-99aa-d2ce450bdb2a None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.694855 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.695400 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.695684 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.695960 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.707363 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.708849 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:43.726570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:43.728280 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:43.729818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:43.729818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:43.729818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:43.729818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 257/507] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:43.729818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.736580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.737204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.737506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.737780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.738517 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] RBAC: Adding query filter params (role.id=066edc5a61cb425d8ea5a64af7eb6706, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=bf84d9f0ae734f04aa277f8624b7bd45) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:43.738826 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.740544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.755729 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 251/508] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/role_assignments?user.id=bf84d9f0ae734f04aa277f8624b7bd45&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=066edc5a61cb425d8ea5a64af7eb6706 => generated 608 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:43.757397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.881810 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.952632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.990009 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366d935-4e83-4fc5-b764-775ebf49d183 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:44.006503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e243-2475-44ed-a39f-85f21d3bf093 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:44.048267 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:44.049328 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.049839 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.050312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.072771 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:44.074038 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1e08d-9eb5-44e2-a9e3-2021369b8e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:44.075100 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1e08d-9eb5-44e2-a9e3-2021369b8e29 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.075951 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1e08d-9eb5-44e2-a9e3-2021369b8e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.076383 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1e08d-9eb5-44e2-a9e3-2021369b8e29 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.077134 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:44.077408 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1e08d-9eb5-44e2-a9e3-2021369b8e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:44.077925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1e08d-9eb5-44e2-a9e3-2021369b8e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:44.080322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1e08d-9eb5-44e2-a9e3-2021369b8e29 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:44.107199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 252/509] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:44.107199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278b84-0447-4282-ad5a-ecda35c72345 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.107199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278b84-0447-4282-ad5a-ecda35c72345 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.107199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278b84-0447-4282-ad5a-ecda35c72345 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:44.107800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:44.108770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:44.109722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:44.109722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:44.109722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:44.109889 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 253/510] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:44.109975 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 258/511] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:44.110046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d29ea-0424-4479-904b-57656ad2d835 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.110672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d29ea-0424-4479-904b-57656ad2d835 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.110844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d29ea-0424-4479-904b-57656ad2d835 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.112615 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:44.113572 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 254/512] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:44.119704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ec00-10e5-4cab-9c92-49ec81dbd6c0 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.120143 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ec00-10e5-4cab-9c92-49ec81dbd6c0 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.120542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1ec00-10e5-4cab-9c92-49ec81dbd6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.151630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-4bf1ec00-10e5-4cab-9c92-49ec81dbd6c0 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:44.153708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-4bf1ec00-10e5-4cab-9c92-49ec81dbd6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:44.281476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 255/513] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:44.281476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b7fe6-e0ac-4de5-999d-8462ee68cee5 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.281476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b7fe6-e0ac-4de5-999d-8462ee68cee5 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.281476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b7fe6-e0ac-4de5-999d-8462ee68cee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.305024 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a23801-e6ac-44a7-afca-652dadeb085d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:44.306766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-160b7fe6-e0ac-4de5-999d-8462ee68cee5 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:44.308853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-160b7fe6-e0ac-4de5-999d-8462ee68cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:44.360720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:44.364440 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:44.379115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:44.380222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.380694 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.381144 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.398248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:44.401172 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:44.423963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:44.424962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:35:44.425949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:44.426894 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 259/514] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 24 08:35:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:44.428134 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:44.459348 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 256/515] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:44.461014 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b7fe6-e0ac-4de5-999d-8462ee68cee5 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:44.644430 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b7fe6-e0ac-4de5-999d-8462ee68cee5 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:44.691332 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:44.692695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.693184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.693715 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.694858 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:44.695384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:44.697696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:44.720693 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 257/516] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 24 08:35:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:44.721872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:44.722369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdabfc-3c9b-4d83-87b3-f902235f9543 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:44.752974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:44.799556 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:44.800922 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.801432 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.801934 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.802822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:44.803352 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:44.804966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:44.820316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 260/517] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:44.821018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:44.885350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:44.898471 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87632c5-9250-4b1f-89da-25b7dc8c98bb None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:44.958024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:44.959092 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:44.959574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:44.960046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:44.961091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:44.963746 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:44.987979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529dbe9-b3e9-4dbc-b6f0-b854b8852b38 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:44.988568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:44.989853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:44.990691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:44.991423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 258/518] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:44 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:44.992856 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:45.037543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:45.038194 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:45.038895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:45.038895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:45.050754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:45.052186 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:45.068708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:45.070658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:45.072310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:45.072310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:45.072310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:45.074662 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 261/519] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:45.075723 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:45.142144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:45.163106 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f66e4-534f-4da2-abdc-71ac1321d8e1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:45.217077 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:45.218103 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:45.218392 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:45.218650 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:45.219377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:45.220779 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:45.230454 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:45.232480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:45.234878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:45.237116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5625e-3e5a-48dc-81f0-2f05da634ff7 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:45.237280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 259/520] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 24 08:35:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:45.237662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:45.238146 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:45.298173 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c2c4-f768-40c1-86c8-0b248c0243bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:45.298798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c2c4-f768-40c1-86c8-0b248c0243bd None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:45.299050 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c2c4-f768-40c1-86c8-0b248c0243bd None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:45.299313 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c2c4-f768-40c1-86c8-0b248c0243bd None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:45.299965 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03c2c4-f768-40c1-86c8-0b248c0243bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:45.301388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03c2c4-f768-40c1-86c8-0b248c0243bd None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:45.337477 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 262/521] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:45 2022] POST /identity/v3/users => generated 254 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:45.337477 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c2c4-f768-40c1-86c8-0b248c0243bd None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:45.416171 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb0209-b561-4ac7-b8d2-e684d8094918 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:45.466602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:45.467579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:45.469760 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:45.470701 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:45.472371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] RBAC: Adding query filter params (name=network) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:45.473231 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:45.477984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:45.488785 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 260/522] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:35:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:45.490115 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:45.514561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:45.544784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c2c4-f768-40c1-86c8-0b248c0243bd None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:45.589234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:45.589882 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:45.590162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:45.590434 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:45.591153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:45.591461 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:45.593678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:45.617245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 263/523] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:45.618904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:45.650646 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedb9d1-3285-4575-9a04-4ade0ea6d57c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:45.651400 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:45.696957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:45.698950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:45.699398 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:45.700095 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:45.701999 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:45.702499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:45.704169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:45.714955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 261/524] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 24 08:35:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:45.714955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:45.779122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1edb4-decc-4410-a066-a075db4d0948 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:45.821848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:45.842873 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9f45-0d32-4798-8794-2bb126c593f4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:45.851193 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:45.852326 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:45.852867 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:45.853427 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:45.854690 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:45.855286 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:45.858526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:45.874119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 264/525] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:35:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:45.875774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:45.885855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:45.886864 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:45.889062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:45.889617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:45.897576 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:45.899510 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:45.914199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:45.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:45.916192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:45.916192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:45.916192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:45.916192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:45.916192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:45.916192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:45.916192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:45.916192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:45.923416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 262/526] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:45.929746 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:46.075467 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96378-20f4-46ee-9463-7b186c09f10f None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:46.117622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:46.118661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.119153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.119630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.120998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:46.121613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:46.124149 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:46.136538 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:46.141971 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 263/527] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:46.148938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:46.167171 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:46.214078 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb9ea7-ab08-4dae-8aaf-76c9fa24a5c1 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:46.289431 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0619d-e7a7-4b5b-a698-99df7c5eca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:46.289431 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0619d-e7a7-4b5b-a698-99df7c5eca86 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.290652 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0619d-e7a7-4b5b-a698-99df7c5eca86 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.290741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0619d-e7a7-4b5b-a698-99df7c5eca86 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.291440 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0619d-e7a7-4b5b-a698-99df7c5eca86 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:46.291693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0619d-e7a7-4b5b-a698-99df7c5eca86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:46.293198 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0619d-e7a7-4b5b-a698-99df7c5eca86 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:46.299317 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 265/528] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 24 08:35:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:46.300365 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac3af-1ae6-49cd-991a-98a201f6554f None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.300733 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac3af-1ae6-49cd-991a-98a201f6554f None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.300971 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac3af-1ae6-49cd-991a-98a201f6554f None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.302644 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 266/529] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:46.311610 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4592d9-6030-4955-8f68-f8c8eac62111 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.312415 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4592d9-6030-4955-8f68-f8c8eac62111 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.313153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4592d9-6030-4955-8f68-f8c8eac62111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.334367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21098e-d89b-4ab2-966b-0c28737a438c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:46.336952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-8a4592d9-6030-4955-8f68-f8c8eac62111 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:46.339248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-8a4592d9-6030-4955-8f68-f8c8eac62111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:46.379343 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48a61a-3908-413e-9fa9-30b47b7d0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:46.380509 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a61a-3908-413e-9fa9-30b47b7d0ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.381046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a61a-3908-413e-9fa9-30b47b7d0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.381679 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48a61a-3908-413e-9fa9-30b47b7d0ed4 None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/5ccd68808df34afb9bc08db5bdd6afa9/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.390272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48a61a-3908-413e-9fa9-30b47b7d0ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=5ccd68808df34afb9bc08db5bdd6afa9, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:46.390272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48a61a-3908-413e-9fa9-30b47b7d0ed4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:46.427438 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 264/530] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:46 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/5ccd68808df34afb9bc08db5bdd6afa9/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:46.484885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 267/531] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:46.802148 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48a61a-3908-413e-9fa9-30b47b7d0ed4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:46.893769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:46.946732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48a61a-3908-413e-9fa9-30b47b7d0ed4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.004630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951b3d-2cff-4d07-aee8-e3ae2f58cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.005292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951b3d-2cff-4d07-aee8-e3ae2f58cebe None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.005603 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951b3d-2cff-4d07-aee8-e3ae2f58cebe None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.005877 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b951b3d-2cff-4d07-aee8-e3ae2f58cebe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.026222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b951b3d-2cff-4d07-aee8-e3ae2f58cebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-2b951b3d-2cff-4d07-aee8-e3ae2f58cebe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:47.032278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:47.033233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:47.034090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:47.037797 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 265/532] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:47.039693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4592d9-6030-4955-8f68-f8c8eac62111 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.164320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:47.194514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4592d9-6030-4955-8f68-f8c8eac62111 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.247100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.248119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.248640 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.249126 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.250061 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:47.250643 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.252224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:47.266053 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 268/533] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:47.271309 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951b3d-2cff-4d07-aee8-e3ae2f58cebe None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.409801 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b951b3d-2cff-4d07-aee8-e3ae2f58cebe None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.435000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:47.451939 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.452580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.452860 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.453132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.464674 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.466818 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:47.482543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:47.483544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:47.484844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:47.484844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:47.484844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:47.484844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 266/534] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:47.490206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.646457 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e554ec-31a6-4cfe-99ba-d191307a25ee None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.706264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.706803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.707077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.707343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.707994 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:47.708290 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.709675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:47.718256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:47.724188 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 269/535] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:47.730055 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.870102 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee199223-93ee-4664-941b-b015cc80dde8 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.909089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.910172 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.910665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.911144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.920196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.922190 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:47.942925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:47.943949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:35:47.944890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:47.947131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 267/536] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:47.953872 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.124230 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775200-4fe4-4b24-a00b-4fa7ff553ccd None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.170687 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.171301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.171581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.171849 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.172581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:48.172885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:48.174348 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.200411 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 270/537] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:48.206395 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.256292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:48.361290 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83cd6b-1c1e-4457-ab3f-22d48eef9830 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.416130 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd7729-53b4-4e69-ace9-95d78021dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.417217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd7729-53b4-4e69-ace9-95d78021dedc None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.417754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd7729-53b4-4e69-ace9-95d78021dedc None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.418252 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd7729-53b4-4e69-ace9-95d78021dedc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.438764 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd7729-53b4-4e69-ace9-95d78021dedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:48.440635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd7729-53b4-4e69-ace9-95d78021dedc None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-5cbd7729-53b4-4e69-ace9-95d78021dedc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:48.458986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:48.460046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:48.460950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:48.460950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:48.460950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:48.463120 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 268/538] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:48.471342 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.622387 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:48.698171 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e512309-9c34-4e18-9066-19e107733b23 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.706481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb158-a568-4025-a4c7-f5b4f758f21c None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.707182 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb158-a568-4025-a4c7-f5b4f758f21c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.707661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb158-a568-4025-a4c7-f5b4f758f21c None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.713474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 269/539] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:48.715133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ded4-99b2-410b-9154-1f4bb53fd790 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.715664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ded4-99b2-410b-9154-1f4bb53fd790 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.716289 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ded4-99b2-410b-9154-1f4bb53fd790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.755690 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-fef6ded4-99b2-410b-9154-1f4bb53fd790 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:48.756895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-fef6ded4-99b2-410b-9154-1f4bb53fd790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:48.759502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.760115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.760385 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.760647 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.761292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:48.761612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:48.763748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.785508 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 271/540] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:48.793751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.940121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 270/541] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:48.940620 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcf2f-20a7-440a-836e-f7483547b601 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.958066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:48.993275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.993997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.994283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.994555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.002942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:49.004469 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:49.024386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:49.025347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:49.026232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 272/542] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:49.034572 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6ded4-99b2-410b-9154-1f4bb53fd790 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:49.083324 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:49.194648 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6ded4-99b2-410b-9154-1f4bb53fd790 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:49.236942 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69abf-ddd9-4f2c-b380-95c428cb9131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:49.237640 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69abf-ddd9-4f2c-b380-95c428cb9131 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.237920 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69abf-ddd9-4f2c-b380-95c428cb9131 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.238191 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69abf-ddd9-4f2c-b380-95c428cb9131 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.238894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69abf-ddd9-4f2c-b380-95c428cb9131 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:49.239194 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69abf-ddd9-4f2c-b380-95c428cb9131 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:49.240619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69abf-ddd9-4f2c-b380-95c428cb9131 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:49.254626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 271/543] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:49.260499 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:49.327659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7874cb-dc82-4754-b9d5-bee5f08d29b7 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.327992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7874cb-dc82-4754-b9d5-bee5f08d29b7 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.327992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7874cb-dc82-4754-b9d5-bee5f08d29b7 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.330003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 272/544] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:49.341887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844f8c-b72c-455c-a840-8d7f0656a535 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.342540 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844f8c-b72c-455c-a840-8d7f0656a535 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.343019 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29844f8c-b72c-455c-a840-8d7f0656a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.373463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-29844f8c-b72c-455c-a840-8d7f0656a535 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:49.377474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-29844f8c-b72c-455c-a840-8d7f0656a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:49.428363 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64b2d-3976-417d-8a08-405d7f173bc9 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:49.509574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 273/545] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:49.510779 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29844f8c-b72c-455c-a840-8d7f0656a535 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:49.516648 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:49.518392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2476-e991-40f0-a9c4-5b61240fc266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:49.519129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2476-e991-40f0-a9c4-5b61240fc266 None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.519503 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2476-e991-40f0-a9c4-5b61240fc266 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.519707 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2476-e991-40f0-a9c4-5b61240fc266 None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/bf84d9f0ae734f04aa277f8624b7bd45/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.526095 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef2476-e991-40f0-a9c4-5b61240fc266 None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=bf84d9f0ae734f04aa277f8624b7bd45, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:49.527800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef2476-e991-40f0-a9c4-5b61240fc266 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:49.561609 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 273/546] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:49 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/bf84d9f0ae734f04aa277f8624b7bd45/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:49.645627 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29844f8c-b72c-455c-a840-8d7f0656a535 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:49.654876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc987409-cd74-46e4-a8ba-af47688c119c None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.655168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc987409-cd74-46e4-a8ba-af47688c119c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.655493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc987409-cd74-46e4-a8ba-af47688c119c None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.656778 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 274/547] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:49.663019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88447-0486-44ca-b0b4-00be81baf8ad None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.663305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88447-0486-44ca-b0b4-00be81baf8ad None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.663567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88447-0486-44ca-b0b4-00be81baf8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.687049 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a18ae2-e526-4af5-b431-74c84ecf8be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:49.687720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a18ae2-e526-4af5-b431-74c84ecf8be3 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.688046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a18ae2-e526-4af5-b431-74c84ecf8be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.688327 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a18ae2-e526-4af5-b431-74c84ecf8be3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.701369 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a18ae2-e526-4af5-b431-74c84ecf8be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:49.705120 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-eab88447-0486-44ca-b0b4-00be81baf8ad None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:49.706370 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-eab88447-0486-44ca-b0b4-00be81baf8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-a1a18ae2-e526-4af5-b431-74c84ecf8be3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:49.706678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:49.709459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:49.712611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 274/548] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:49.725885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a18ae2-e526-4af5-b431-74c84ecf8be3 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:49.750618 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:49.803541 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:49.806815 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 275/549] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:49.808452 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfc12d-2a3f-4642-98e3-8a8a7f182cbc None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.808811 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfc12d-2a3f-4642-98e3-8a8a7f182cbc None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.809147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfc12d-2a3f-4642-98e3-8a8a7f182cbc None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.813579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 276/550] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:49.818148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b0ca-7a3e-42da-94b3-c446d7eeb043 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.818432 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b0ca-7a3e-42da-94b3-c446d7eeb043 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.818704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b0ca-7a3e-42da-94b3-c446d7eeb043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.848191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-36e0b0ca-7a3e-42da-94b3-c446d7eeb043 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:49.850682 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-36e0b0ca-7a3e-42da-94b3-c446d7eeb043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:49.859362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a18ae2-e526-4af5-b431-74c84ecf8be3 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:49.898890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:49.899504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.899785 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.900057 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.900723 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:49.901023 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:49.902427 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:49.918436 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 275/551] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:49.928487 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:49.956062 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 277/552] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:50.054844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6fa5d-b399-4645-99d1-9949dd1a084c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.088416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.092483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.093376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.093763 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.094112 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.106016 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.108197 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:50.123520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:50.126285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:50.128320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:50.128320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:50.128320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:50.128320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 276/553] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:50.133078 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0b0ca-7a3e-42da-94b3-c446d7eeb043 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.139233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.261951 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd402-7242-4876-811c-48d98b055547 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.266521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.273275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0b0ca-7a3e-42da-94b3-c446d7eeb043 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.302011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.302919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.303194 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.303467 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.304096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:50.304390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.305870 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.314962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfee42-d5e8-4514-898c-25cb97811800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.315580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfee42-d5e8-4514-898c-25cb97811800 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.315854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfee42-d5e8-4514-898c-25cb97811800 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.316170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfee42-d5e8-4514-898c-25cb97811800 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.316787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfee42-d5e8-4514-898c-25cb97811800 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.318435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfee42-d5e8-4514-898c-25cb97811800 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.318543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 277/554] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:50.319800 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.336871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 278/555] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:35:50 2022] POST /identity/v3/services => generated 240 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:50.338565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfee42-d5e8-4514-898c-25cb97811800 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.372007 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.462775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01aad64-663b-4ce9-a1b0-5a326050dcc9 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.508311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfee42-d5e8-4514-898c-25cb97811800 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.518601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d2d15-f991-4a71-8628-1dd66feaa040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.519252 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d2d15-f991-4a71-8628-1dd66feaa040 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.519531 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d2d15-f991-4a71-8628-1dd66feaa040 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.519906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d2d15-f991-4a71-8628-1dd66feaa040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.544041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d2d15-f991-4a71-8628-1dd66feaa040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:50.553016 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37642c16-aed9-447e-be39-2ea338b1e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.553696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642c16-aed9-447e-be39-2ea338b1e295 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-1d1d2d15-f991-4a71-8628-1dd66feaa040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:50.553806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:50.554681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:50.555516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:50.556718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642c16-aed9-447e-be39-2ea338b1e295 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.556718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642c16-aed9-447e-be39-2ea338b1e295 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.556718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37642c16-aed9-447e-be39-2ea338b1e295 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.556931 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 278/556] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:50.557003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37642c16-aed9-447e-be39-2ea338b1e295 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.558505 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d2d15-f991-4a71-8628-1dd66feaa040 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.579077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 279/557] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:35:50 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:50.580017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37642c16-aed9-447e-be39-2ea338b1e295 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.602406 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.761870 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.763595 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37642c16-aed9-447e-be39-2ea338b1e295 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.774849 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d2d15-f991-4a71-8628-1dd66feaa040 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.821581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.822123 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.822398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.822661 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.823325 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:50.823658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.824636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.825054 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.825839 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.826494 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.826867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.836064 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.837875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.839945 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 280/558] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:50.850576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:50.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:50.858743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:35:50.860610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:50.861379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 279/559] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:50.869919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.946497 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.995391 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5f038-fe64-4305-a219-961807640777 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.998980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ae11b-8a05-4e06-a949-3f085eecfd86 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.041528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.042564 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.042992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.043591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.044482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.045132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.045402 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:51.045565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.045803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.046149 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.048199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.071282 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.078918 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 280/560] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:51.084155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:51.095999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:51.096985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:51.097890 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:51.097890 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:51.097890 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:51.110409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 281/561] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:51.111363 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.120658 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:51.249715 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc912-747a-4e57-8eb4-deb20c2ef5df None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.315377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.316024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.316297 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.316568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.327496 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b537b6-981c-46ef-a81f-8e26ee576176 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.337014 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.346382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:51.379396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:51.382081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:51.384636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:51.384636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:51.384636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:51.384636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 281/562] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:51.385946 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:51.391569 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.414419 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.415459 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.416618 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.417096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.418152 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:51.420094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.421739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.443170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 282/563] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:51.449339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.482837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:51.527620 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4901c7-e4a0-4bd7-8d88-1c874d4caada None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.579296 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.580137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.580518 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.580891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.582442 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:51.584140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.586880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.619686 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 282/564] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:51.636719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.651053 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab864c-a938-4b6e-aa3d-12dc89edea51 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.732857 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.733782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.734225 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.734655 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.753170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.754911 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:51.783002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:51.784197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:35:51.785332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:51.789996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 283/565] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:51.795414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.824921 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f6978-5c5a-42b5-8e9a-44c94dc94884 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.876578 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:51.885697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:51.901868 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.902500 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.902769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.903033 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.913508 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.914965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:51.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:51.936964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:51.938280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 283/566] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:51.946787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:52.023594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175a319-3655-4e13-ab49-55a55d7acb66 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:52.084343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.084952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.085228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.085520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.086254 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:52.086554 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.087983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.107792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b1e73-30f7-4b3d-9d2b-33d4561c98d9 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:52.125431 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 284/567] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:52.132158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:52.161992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.162647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.162918 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.163183 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.163916 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:52.164210 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.165728 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.190881 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 284/568] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:52.202525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:52.266394 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:52.339679 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:52.344785 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02e573-a2b8-45d2-9220-2a39a5475dc9 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:52.370437 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aaadd9-a3d9-4b6b-95b1-0479c0b5af0b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:52.388110 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146846f3-3638-4a04-aa79-8431929006c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.389170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146846f3-3638-4a04-aa79-8431929006c8 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.389699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146846f3-3638-4a04-aa79-8431929006c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.390172 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146846f3-3638-4a04-aa79-8431929006c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.429864 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b16fbf-ff49-48bb-abc8-80b9bcaa3cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.430513 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b16fbf-ff49-48bb-abc8-80b9bcaa3cdf None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.431507 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b16fbf-ff49-48bb-abc8-80b9bcaa3cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.431802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b16fbf-ff49-48bb-abc8-80b9bcaa3cdf None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/a351023812dd4bd2ad078374bab98b89/roles/066edc5a61cb425d8ea5a64af7eb6706` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.451844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b16fbf-ff49-48bb-abc8-80b9bcaa3cdf None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=a351023812dd4bd2ad078374bab98b89, role_id=066edc5a61cb425d8ea5a64af7eb6706)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.453828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b16fbf-ff49-48bb-abc8-80b9bcaa3cdf None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.477669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 285/569] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:52 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/a351023812dd4bd2ad078374bab98b89/roles/066edc5a61cb425d8ea5a64af7eb6706 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:52.477669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880af89-b836-49ea-831f-3aff867f8047 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.477669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880af89-b836-49ea-831f-3aff867f8047 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.477669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880af89-b836-49ea-831f-3aff867f8047 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.477669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 286/570] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:52.495465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039af04d-351b-422c-827e-50324caa03b7 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.495803 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039af04d-351b-422c-827e-50324caa03b7 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.496066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039af04d-351b-422c-827e-50324caa03b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.501094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146846f3-3638-4a04-aa79-8431929006c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.505698 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146846f3-3638-4a04-aa79-8431929006c8 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.531136 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-039af04d-351b-422c-827e-50324caa03b7 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:52.532369 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-039af04d-351b-422c-827e-50324caa03b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:52.705531 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:52.707622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 287/571] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:35:52.718376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 285/572] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:35:52.723516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039af04d-351b-422c-827e-50324caa03b7 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:52.758517 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:52.867097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039af04d-351b-422c-827e-50324caa03b7 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:52.916553 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.917209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.917507 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.917779 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.935231 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.936851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:52.958206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:52.959254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:52.960132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:52.960132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:52.960132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:52.960132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 288/573] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:52.967048 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146846f3-3638-4a04-aa79-8431929006c8 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.009005 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.169350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146846f3-3638-4a04-aa79-8431929006c8 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.173797 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:53.202803 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496e06-ea1e-4b75-b5a0-2df7beea4599 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.209676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3cabc-9dd1-40b6-ab7f-72d47d5d134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.210213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cabc-9dd1-40b6-ab7f-72d47d5d134c None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.210618 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cabc-9dd1-40b6-ab7f-72d47d5d134c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.210890 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3cabc-9dd1-40b6-ab7f-72d47d5d134c None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.211538 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3cabc-9dd1-40b6-ab7f-72d47d5d134c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:53.211833 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3cabc-9dd1-40b6-ab7f-72d47d5d134c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:53.213330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3cabc-9dd1-40b6-ab7f-72d47d5d134c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:53.229600 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 286/574] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:53.232170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d383a-3e8a-49c1-b579-c51a0785a066 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.233066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d383a-3e8a-49c1-b579-c51a0785a066 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.233352 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d383a-3e8a-49c1-b579-c51a0785a066 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.234684 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 287/575] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:53.235810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201985a-1cc4-4242-9e27-39dc6b550999 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.236087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201985a-1cc4-4242-9e27-39dc6b550999 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.236335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201985a-1cc4-4242-9e27-39dc6b550999 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.237806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 288/576] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:53.240698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1cd2-d0ce-4b5a-9cee-4f3145f3ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.241950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1cd2-d0ce-4b5a-9cee-4f3145f3ded1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.242238 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1cd2-d0ce-4b5a-9cee-4f3145f3ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.242501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1cd2-d0ce-4b5a-9cee-4f3145f3ded1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.242597 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201985a-1cc4-4242-9e27-39dc6b550999 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.253301 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc1cd2-d0ce-4b5a-9cee-4f3145f3ded1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-90dc1cd2-d0ce-4b5a-9cee-4f3145f3ded1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:53.258504 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:53.259446 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:53.260281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 289/577] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:53.261479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dd9f8-cf04-458a-a54d-54a600225638 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.261479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dd9f8-cf04-458a-a54d-54a600225638 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.261636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dd9f8-cf04-458a-a54d-54a600225638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.286068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-c80dd9f8-cf04-458a-a54d-54a600225638 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:53.287251 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-c80dd9f8-cf04-458a-a54d-54a600225638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:53.306594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:53.353810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201985a-1cc4-4242-9e27-39dc6b550999 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.365367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 290/578] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:35:53.365367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fc04-8366-4d26-ad72-03ac2965b012 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.365367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fc04-8366-4d26-ad72-03ac2965b012 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.365367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fc04-8366-4d26-ad72-03ac2965b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.378609 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-c786fc04-8366-4d26-ad72-03ac2965b012 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:53.379867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-c786fc04-8366-4d26-ad72-03ac2965b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:53.397920 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.399271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.399991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.400575 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.417833 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:53.423120 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:53.448872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:53.455824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:53.456734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:53.457745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:53.457745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:53.457745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:53.457745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:53.457745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:53.457745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:53.457745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:53.457745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:53.458355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 291/579] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:35:53.459361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786fc04-8366-4d26-ad72-03ac2965b012 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.466516 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 289/580] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:53.467953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.642443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786fc04-8366-4d26-ad72-03ac2965b012 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.684291 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.685482 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.685746 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.686010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.686676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:53.686968 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:53.688330 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:53.691916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9616ffc-f14b-421d-ab94-086ef9deec2f None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.700995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 292/581] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:53.702261 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.720228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:53.736414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.737117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.737399 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.737697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.738438 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:53.738743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:53.740250 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:53.754583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 290/582] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:53.761463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.783387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:53.830641 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb9e7c-2414-46e7-8447-c1c06781614e None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.864330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8fc73-5c4f-4ab5-95a6-b22bdb2c1da7 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.867824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.868466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.868746 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.869014 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] PATH_INFO: `/v3/services/network` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.869636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:53.871016 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:53.880802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:53.881984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:53.882888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 293/583] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:53.884417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.908584 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.909221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.909537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.909812 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.921318 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:53.922898 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:53.939124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:53.940341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:53.941237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:53.941237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:53.941237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:53.941237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 291/584] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:53.941509 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.986365 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.002214 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec22f9-ad8d-4075-9048-9c408d837e80 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.028210 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.043025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.043652 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.044456 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.044745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.045744 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.047112 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:54.057042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:54.058134 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:54.059060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 294/585] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:54.060585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.068450 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d8c49-9724-436c-9740-049c51408e82 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.103303 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.103911 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.104191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.104462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.105189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=5ccd68808df34afb9bc08db5bdd6afa9) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.105517 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.107789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.113941 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 292/586] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/role_assignments?user.id=5ccd68808df34afb9bc08db5bdd6afa9&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=ebf9799815574909aa1c88e93e213c96 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.114736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.193823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca066b-cb9c-4732-8768-29348536c511 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.241609 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.242751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.243479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.243935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.245267 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] RBAC: Adding query filter params (name=network) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.245770 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.247895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.254731 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 295/587] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.255903 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.276877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ab655-b799-4d5a-b0db-a18f50777333 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.322452 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.323429 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.323735 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.324110 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.324573 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.326109 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.326950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.329284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.344227 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 293/588] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.345479 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.390548 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589b81f-badc-475e-afa8-be0fea40cfbc None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.433959 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.435324 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.435631 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.435900 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.436645 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.436943 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.438338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.444601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 296/589] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.445693 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.480604 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80000d-9993-481b-abea-63a56ba3c321 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.535884 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.537515 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.538035 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.538672 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.539884 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] RBAC: Adding query filter params (type=network) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.540674 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.542365 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.551218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 294/590] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.552438 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.583482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.591841 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ef04a-5fba-4d20-beef-0679a1a1bd25 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.625932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.644373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.644373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.644373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.644373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] PATH_INFO: `/v3/users/swift` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.655747 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.657201 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:54.673298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:54.674375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:54.675399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 297/591] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:54.676020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.714423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2cad-b848-46e5-938b-f0f55be8b63c None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.765930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.767447 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.767882 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.768300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.769604 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.770147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.772469 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.781786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 295/592] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.782876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.806386 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc303-cae2-4954-b939-5cb8110ab33f None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.859242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.860213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.861280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.861790 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.863067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] RBAC: Adding query filter params (interface=public, service_id=aaba59f2d3834f71a0de86403c94a547, region_id=RegionOne) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.863627 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.866593 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.885113 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 298/593] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/endpoints?service_id=aaba59f2d3834f71a0de86403c94a547&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.885113 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.923555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5cd36-253d-438a-b0f5-037af94a5cc3 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.954714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.963513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.964388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.964766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.965253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.966673 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.967380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.970658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.993169 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 296/594] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.994388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.044735 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed846dd2-3c75-4f3e-9d5f-6fabd7512611 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.083796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c3c31-1968-4f03-8793-84fcddb8e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.084321 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3c31-1968-4f03-8793-84fcddb8e7f2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.084600 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3c31-1968-4f03-8793-84fcddb8e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.084979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3c31-1968-4f03-8793-84fcddb8e7f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.085819 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c3c31-1968-4f03-8793-84fcddb8e7f2 None admin] RBAC: Adding query filter params (interface=public, service_id=144926f7d7a4423ab746e8de54ec6cde, region_id=RegionOne) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:55.086142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c3c31-1968-4f03-8793-84fcddb8e7f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.087515 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c3c31-1968-4f03-8793-84fcddb8e7f2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.098672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 299/595] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/endpoints?service_id=144926f7d7a4423ab746e8de54ec6cde&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:55.098672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814e9f-6ac8-4901-914e-490e469ff70b None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.098672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814e9f-6ac8-4901-914e-490e469ff70b None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.098672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d814e9f-6ac8-4901-914e-490e469ff70b None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.098672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 300/596] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:55.098672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d814e9f-6ac8-4901-914e-490e469ff70b None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.117027 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8ccc-e9ad-4bf2-a702-a08051cc956a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.156726 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7387f58-f18c-4585-aa71-0bdf6d6a2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.157342 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387f58-f18c-4585-aa71-0bdf6d6a2d06 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.157648 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387f58-f18c-4585-aa71-0bdf6d6a2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.157920 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387f58-f18c-4585-aa71-0bdf6d6a2d06 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.158526 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7387f58-f18c-4585-aa71-0bdf6d6a2d06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.159946 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7387f58-f18c-4585-aa71-0bdf6d6a2d06 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.166004 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 297/597] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:55.166910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7387f58-f18c-4585-aa71-0bdf6d6a2d06 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.185349 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:55.243975 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d814e9f-6ac8-4901-914e-490e469ff70b None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.255213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:55.289800 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0c9dd-bed0-4488-b4ef-e3426642064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.290430 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c9dd-bed0-4488-b4ef-e3426642064b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.290757 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c9dd-bed0-4488-b4ef-e3426642064b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.291036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0c9dd-bed0-4488-b4ef-e3426642064b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.322647 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7387f58-f18c-4585-aa71-0bdf6d6a2d06 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.378475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c36837-5ff3-4c44-bc18-9e71c59eaa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.379072 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36837-5ff3-4c44-bc18-9e71c59eaa08 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.379355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36837-5ff3-4c44-bc18-9e71c59eaa08 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.379626 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c36837-5ff3-4c44-bc18-9e71c59eaa08 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.380875 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c36837-5ff3-4c44-bc18-9e71c59eaa08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.382351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c36837-5ff3-4c44-bc18-9e71c59eaa08 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.383985 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0c9dd-bed0-4488-b4ef-e3426642064b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.385668 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0c9dd-bed0-4488-b4ef-e3426642064b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.391848 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 298/598] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:35:55 2022] GET /identity/v3/services => generated 772 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:55.393207 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916801b-62bb-4cac-8b01-d92aafb3ec62 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.393612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916801b-62bb-4cac-8b01-d92aafb3ec62 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.393903 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916801b-62bb-4cac-8b01-d92aafb3ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.419880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-a916801b-62bb-4cac-8b01-d92aafb3ec62 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:55.421178 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a916801b-62bb-4cac-8b01-d92aafb3ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:55.511147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 301/599] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:35:55.519855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0c9dd-bed0-4488-b4ef-e3426642064b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.534002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:55.542723 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:55.555226 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 299/600] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:35:55.674307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0c9dd-bed0-4488-b4ef-e3426642064b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.712119 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.713195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.713748 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.714226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.726432 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.728439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:55.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:55.748025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:55.748941 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:55.748941 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:55.748941 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:55.751346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 302/601] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:55.759328 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916801b-62bb-4cac-8b01-d92aafb3ec62 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.932481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.990875 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916801b-62bb-4cac-8b01-d92aafb3ec62 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.035438 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.036504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.036984 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.037488 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.038486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:56.039116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:56.041394 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:56.052665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:56.058239 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 300/602] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:56.063908 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.143814 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13ae61-27bd-447b-930f-a1a7d5352176 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.166595 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:56.197775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8182a-f668-441f-9889-39810462950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.198343 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8182a-f668-441f-9889-39810462950f None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.198616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8182a-f668-441f-9889-39810462950f None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.198884 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8182a-f668-441f-9889-39810462950f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.212698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8182a-f668-441f-9889-39810462950f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-34c8182a-f668-441f-9889-39810462950f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:56.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:56.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:56.220379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 303/603] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:56.225743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8182a-f668-441f-9889-39810462950f None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.243557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74702a29-b56c-4453-be7d-4c81e354a9b3 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.298842 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.299585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.299871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.300143 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.307936 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:56.309592 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:56.335256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:56.336218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:56.337100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 301/604] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:56.342885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.361319 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8182a-f668-441f-9889-39810462950f None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.396902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:56.462297 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.462840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.463110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.463373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.464046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:56.464347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:56.466335 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:56.482224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 304/605] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:56.487370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.525243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88669e-3879-4b41-9332-fb9f0bd976fe None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.565728 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:56.601081 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.601758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.602031 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.602293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.602986 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:56.603282 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:56.604720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:56.639309 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 302/606] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:56.645220 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.656261 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0c135-7686-4d08-99df-8275f3aa04d9 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.748079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.748812 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.749088 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.749353 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.770058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:56.771547 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:56.792872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:56.794039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:56.795002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:56.795002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:56.795002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:56.798650 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 305/607] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:56.803397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.821470 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d7157-e804-40b3-8646-27f86c4ad7c3 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.862858 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:56.871753 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5581d2-fb08-4ed5-bce9-866c90e94b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.872543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5581d2-fb08-4ed5-bce9-866c90e94b10 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.872868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5581d2-fb08-4ed5-bce9-866c90e94b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.873198 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5581d2-fb08-4ed5-bce9-866c90e94b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.874259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5581d2-fb08-4ed5-bce9-866c90e94b10 None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=bf84d9f0ae734f04aa277f8624b7bd45) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:56.874564 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5581d2-fb08-4ed5-bce9-866c90e94b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:56.876123 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5581d2-fb08-4ed5-bce9-866c90e94b10 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:56.882905 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 303/608] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/role_assignments?user.id=bf84d9f0ae734f04aa277f8624b7bd45&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=ebf9799815574909aa1c88e93e213c96 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:56.968812 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dae680-664e-48f2-85f4-8486c1abd783 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.979308 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8dd56-3143-45e0-8e77-f5ac9871506d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.979857 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8dd56-3143-45e0-8e77-f5ac9871506d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.980228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8dd56-3143-45e0-8e77-f5ac9871506d None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.982668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 304/609] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:56.989858 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c394-c4d0-4765-8037-3eaf0fe733b5 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.990278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c394-c4d0-4765-8037-3eaf0fe733b5 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.990645 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c394-c4d0-4765-8037-3eaf0fe733b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.011038 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-fc29c394-c4d0-4765-8037-3eaf0fe733b5 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:57.011471 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:57.012182 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.013285 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-fc29c394-c4d0-4765-8037-3eaf0fe733b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:57.013420 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.014352 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:57.014656 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:57.016101 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:57.032420 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 306/610] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:57.040034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:57.126632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:57.153566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:57.169417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa786ad-2135-4c6b-b9da-6310f0d5f2a1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:57.195712 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 305/611] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:35:57.220587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:57.221226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.221528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.221801 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.230039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:57.231575 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:35:57.245096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:57.246142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:57.247622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 307/612] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 24 08:35:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:57.252999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29c394-c4d0-4765-8037-3eaf0fe733b5 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:57.375754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29c394-c4d0-4765-8037-3eaf0fe733b5 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:57.421607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:57.422243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.422525 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.422802 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.423933 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:57.424355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:57.425874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:57.457242 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 306/613] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 24 08:35:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:57.464102 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:57.543400 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:57.607290 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4992f-99c8-4643-b359-4f88f8cb9847 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:57.618047 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:57.647695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667932af-b5e7-4835-8fde-39d6af7bd96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:57.647695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667932af-b5e7-4835-8fde-39d6af7bd96b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.647953 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667932af-b5e7-4835-8fde-39d6af7bd96b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.648050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667932af-b5e7-4835-8fde-39d6af7bd96b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.668126 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:57.726453 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667932af-b5e7-4835-8fde-39d6af7bd96b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:57.727935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667932af-b5e7-4835-8fde-39d6af7bd96b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:57.764276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb368f1-fcc2-40ad-9a02-d638b0a872fb None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:57.852018 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 308/614] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:35:57.858270 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:57.858528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667932af-b5e7-4835-8fde-39d6af7bd96b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:57.859358 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.859833 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.860248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.861024 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:57.862634 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:57.895087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:57.896106 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:35:57.896978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:57.900068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 307/615] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 24 08:35:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:57.906671 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:57.917719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:57.980664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667932af-b5e7-4835-8fde-39d6af7bd96b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.027533 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.029060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.029535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.029947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.045506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:58.047429 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:58.066212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:58.067336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:58.068239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:58.068239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:58.068239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:35:58.071194 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 309/616] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:58.078030 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.144166 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef6e0-073f-4c91-92ca-94dbfe2926cf None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.147879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.189514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a05cc-e25c-411c-b355-1eee426b46ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.190911 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a05cc-e25c-411c-b355-1eee426b46ec None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.191473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a05cc-e25c-411c-b355-1eee426b46ec None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.191927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a05cc-e25c-411c-b355-1eee426b46ec None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.192754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a05cc-e25c-411c-b355-1eee426b46ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:58.193260 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a05cc-e25c-411c-b355-1eee426b46ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:58.196347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a05cc-e25c-411c-b355-1eee426b46ec None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:58.202980 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 308/617] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:35:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:58.205170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cc42-1432-494d-aa5a-25c63be64dcc None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.206130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cc42-1432-494d-aa5a-25c63be64dcc None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.206565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049cc42-1432-494d-aa5a-25c63be64dcc None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.208800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 309/618] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:58.209901 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049cc42-1432-494d-aa5a-25c63be64dcc None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.285001 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.290875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbe2f4-5f4d-44c9-910c-0aa6207dc5e4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.339466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aaa4f-4580-4b0e-a2a3-211ef5c8f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.341338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aaa4f-4580-4b0e-a2a3-211ef5c8f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.342241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aaa4f-4580-4b0e-a2a3-211ef5c8f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.342709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aaa4f-4580-4b0e-a2a3-211ef5c8f7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.343671 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aaa4f-4580-4b0e-a2a3-211ef5c8f7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:58.344485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aaa4f-4580-4b0e-a2a3-211ef5c8f7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:58.347229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aaa4f-4580-4b0e-a2a3-211ef5c8f7a7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:58.369430 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 310/619] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:58.371374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3eef-2fc7-4747-938b-fbff45929fc6 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.371791 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3eef-2fc7-4747-938b-fbff45929fc6 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.372357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3eef-2fc7-4747-938b-fbff45929fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.376694 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049cc42-1432-494d-aa5a-25c63be64dcc None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.395880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-400e3eef-2fc7-4747-938b-fbff45929fc6 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:58.398167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-400e3eef-2fc7-4747-938b-fbff45929fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:58.424127 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.425297 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.425710 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.426154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.427366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:58.427781 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:58.429752 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:58.441087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 310/620] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:58.441087 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.481926 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.525270 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 311/621] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:35:58.527483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da3df6-13f9-4f4d-ac04-25aa2f6094b3 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.527900 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da3df6-13f9-4f4d-ac04-25aa2f6094b3 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.528421 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da3df6-13f9-4f4d-ac04-25aa2f6094b3 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.530283 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 312/622] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:58.538441 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b11f-7c80-422a-adcf-3c060494d0ec None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.538982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b11f-7c80-422a-adcf-3c060494d0ec None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.540108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b11f-7c80-422a-adcf-3c060494d0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.584070 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-1ad7b11f-7c80-422a-adcf-3c060494d0ec None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:58.585634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-1ad7b11f-7c80-422a-adcf-3c060494d0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:58.645424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833881-9d01-4b52-975b-80bc68d14553 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.705634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 313/623] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:35:58.712912 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.713870 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.714317 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.714774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.724053 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:58.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:35:58.738322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:58.739569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:58.740877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:35:58.740877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:35:58.740877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:35:58.740877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:35:58.740877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:35:58.740877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:35:58.740877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:35:58.740877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:58.743234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 311/624] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:58.750783 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b11f-7c80-422a-adcf-3c060494d0ec None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.775708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.834585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.876724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b11f-7c80-422a-adcf-3c060494d0ec None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.948894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.949537 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.949819 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.950241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.951290 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:58.951596 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:58.953047 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:58.980140 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.982944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 314/625] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:58.988862 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.015909 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49406eb-ae5e-4e29-b357-ae1620b97938 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.057704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.058348 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.058626 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.058895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] PATH_INFO: `/v3/services/network` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.059577 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.060904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:59.077567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:59.078636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:35:59.079468 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:59.083370 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 312/626] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:59.085003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.122896 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.147615 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818b80-9748-4db1-91f0-08ed365c2a42 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.190110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.190744 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.191020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.191292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.192025 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] RBAC: Adding query filter params (role.id=066edc5a61cb425d8ea5a64af7eb6706, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=a351023812dd4bd2ad078374bab98b89) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:59.192331 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.193810 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.204798 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 315/627] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/role_assignments?user.id=a351023812dd4bd2ad078374bab98b89&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=066edc5a61cb425d8ea5a64af7eb6706 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:59.205469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.243829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e4740-c081-446e-90e3-ff7f6dec47b4 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.327758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.328897 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.329611 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.330212 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.331023 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.332953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:59.344320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:59.345372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:35:59.346238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:35:59.353793 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 313/628] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Oct 24 08:35:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:59.356793 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.385822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.464482 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc8cf8-b30d-497f-94ce-959c0cace906 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.490021 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c000961-83bc-44d0-b06d-84919b148838 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.515735 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.516361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.516660 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.517016 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.518375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] RBAC: Adding query filter params (name=network) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:59.518375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.519315 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.525678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 316/629] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:35:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:59.534984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.546928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.547867 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.548440 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.548895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.549702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:59.550154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.550876 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.552916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.564997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 314/630] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 24 08:35:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:59.566553 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.688122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.696745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd95e9-a6fe-4cd6-a917-fe11630612d4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.737394 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215c4af-77ee-47a3-ae30-a78d860a403c None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.761033 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1494b04-0534-42be-9a10-eb59d3193fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.761695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1494b04-0534-42be-9a10-eb59d3193fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.761970 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1494b04-0534-42be-9a10-eb59d3193fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.762239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1494b04-0534-42be-9a10-eb59d3193fd4 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.762949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1494b04-0534-42be-9a10-eb59d3193fd4 None admin] RBAC: Adding query filter params (type=network) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:59.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1494b04-0534-42be-9a10-eb59d3193fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.764912 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1494b04-0534-42be-9a10-eb59d3193fd4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.777553 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 317/631] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:35:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:59.777553 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961fd89-70c3-4c35-9a06-28cd30f4cc74 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.777553 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961fd89-70c3-4c35-9a06-28cd30f4cc74 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.777553 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961fd89-70c3-4c35-9a06-28cd30f4cc74 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.777553 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 318/632] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:59.777956 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961fd89-70c3-4c35-9a06-28cd30f4cc74 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.789268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8952e3-572e-4563-b325-c6733b5775b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.790875 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8952e3-572e-4563-b325-c6733b5775b7 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.791387 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8952e3-572e-4563-b325-c6733b5775b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.791853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8952e3-572e-4563-b325-c6733b5775b7 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.793069 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8952e3-572e-4563-b325-c6733b5775b7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:59.793606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8952e3-572e-4563-b325-c6733b5775b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.796609 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8952e3-572e-4563-b325-c6733b5775b7 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.803818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 315/633] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Oct 24 08:35:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:59.805319 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202098c-a773-4c5d-9f5e-7321a3ee0081 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.805819 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202098c-a773-4c5d-9f5e-7321a3ee0081 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.806285 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202098c-a773-4c5d-9f5e-7321a3ee0081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.830539 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-8202098c-a773-4c5d-9f5e-7321a3ee0081 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:59.832108 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-8202098c-a773-4c5d-9f5e-7321a3ee0081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:59.874267 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.917248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961fd89-70c3-4c35-9a06-28cd30f4cc74 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.924332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 316/634] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:35:59.929996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202098c-a773-4c5d-9f5e-7321a3ee0081 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.989571 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34978daf-bf3b-405e-84cb-055c5d657d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.990327 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978daf-bf3b-405e-84cb-055c5d657d97 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.990694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978daf-bf3b-405e-84cb-055c5d657d97 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.991057 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978daf-bf3b-405e-84cb-055c5d657d97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.991838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34978daf-bf3b-405e-84cb-055c5d657d97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.994351 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34978daf-bf3b-405e-84cb-055c5d657d97 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:00.037573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 319/635] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:35:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:00.057640 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:00.107296 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202098c-a773-4c5d-9f5e-7321a3ee0081 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:00.170322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb2ab-6c4c-42ab-96b6-29c832b7f2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:00.171369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb2ab-6c4c-42ab-96b6-29c832b7f2ef None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:00.171796 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb2ab-6c4c-42ab-96b6-29c832b7f2ef None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:00.172228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cb2ab-6c4c-42ab-96b6-29c832b7f2ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:00.173067 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cb2ab-6c4c-42ab-96b6-29c832b7f2ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:00.174686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cb2ab-6c4c-42ab-96b6-29c832b7f2ef None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:00.208754 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 317/636] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:35:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:00.281550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34978daf-bf3b-405e-84cb-055c5d657d97 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:00.407691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34978daf-bf3b-405e-84cb-055c5d657d97 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:00.441589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:00.462162 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:00.462797 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:00.463073 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:00.463333 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:00.463906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:00.465260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:00.477895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:00.479152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:00.480220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 320/637] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:00.485396 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb2ab-6c4c-42ab-96b6-29c832b7f2ef None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:00.607388 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cb2ab-6c4c-42ab-96b6-29c832b7f2ef None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:00.632883 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:00.646736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16f215-d2a2-4997-afb6-584be8b4a627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:00.647826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f215-d2a2-4997-afb6-584be8b4a627 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:00.648541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f215-d2a2-4997-afb6-584be8b4a627 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:00.648812 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16f215-d2a2-4997-afb6-584be8b4a627 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:00.649474 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16f215-d2a2-4997-afb6-584be8b4a627 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:00.649779 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16f215-d2a2-4997-afb6-584be8b4a627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:00.651163 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16f215-d2a2-4997-afb6-584be8b4a627 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:00.661172 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 318/638] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:00.662557 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:00.798807 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d778fe-4c49-4e57-b03a-e46fac00ba98 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:00.836001 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10237f4-67c7-4732-9ef2-b0cf22bb754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:00.836611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10237f4-67c7-4732-9ef2-b0cf22bb754d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:00.836888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10237f4-67c7-4732-9ef2-b0cf22bb754d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:00.837158 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10237f4-67c7-4732-9ef2-b0cf22bb754d None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:00.837823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10237f4-67c7-4732-9ef2-b0cf22bb754d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:00.838129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10237f4-67c7-4732-9ef2-b0cf22bb754d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:00.839485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10237f4-67c7-4732-9ef2-b0cf22bb754d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:00.844850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 321/639] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:01.170389 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc754-32aa-46a5-9897-a79c59cfa7bc None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.170928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc754-32aa-46a5-9897-a79c59cfa7bc None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.170928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc754-32aa-46a5-9897-a79c59cfa7bc None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.172543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 319/640] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:01.178065 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b03a1-584c-412a-8110-99c80df24e9f None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.178347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b03a1-584c-412a-8110-99c80df24e9f None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.178623 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b03a1-584c-412a-8110-99c80df24e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.197736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-c47b03a1-584c-412a-8110-99c80df24e9f None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:01.198937 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-c47b03a1-584c-412a-8110-99c80df24e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:01.249982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:01.271388 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 322/641] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:01.542315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edc754-32aa-46a5-9897-a79c59cfa7bc None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:01.657206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edc754-32aa-46a5-9897-a79c59cfa7bc None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:01.693944 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3c89e-77fa-418c-85a8-d110b5b264e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:01.694953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c89e-77fa-418c-85a8-d110b5b264e2 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.695473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c89e-77fa-418c-85a8-d110b5b264e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.695961 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3c89e-77fa-418c-85a8-d110b5b264e2 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.696821 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3c89e-77fa-418c-85a8-d110b5b264e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:01.698424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3c89e-77fa-418c-85a8-d110b5b264e2 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:01.715208 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 320/642] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:01 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:01.724577 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ace70-4d86-4378-af6a-6ede0708d335 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.725147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ace70-4d86-4378-af6a-6ede0708d335 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.725147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ace70-4d86-4378-af6a-6ede0708d335 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.726829 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 323/643] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:01.735446 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ff33-05d0-4618-bb9a-84b2c24676bb None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ff33-05d0-4618-bb9a-84b2c24676bb None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.736658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14ff33-05d0-4618-bb9a-84b2c24676bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.758747 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-1b14ff33-05d0-4618-bb9a-84b2c24676bb None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:01.760366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-1b14ff33-05d0-4618-bb9a-84b2c24676bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:01.815905 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:01.856096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 321/644] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:02.143375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ace70-4d86-4378-af6a-6ede0708d335 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.258206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ace70-4d86-4378-af6a-6ede0708d335 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.300177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f8f3-a901-4588-9ae8-712fbb11e1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.300874 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f8f3-a901-4588-9ae8-712fbb11e1bb None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.301153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f8f3-a901-4588-9ae8-712fbb11e1bb None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.301423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f8f3-a901-4588-9ae8-712fbb11e1bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.312444 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8f8f3-a901-4588-9ae8-712fbb11e1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-4dd8f8f3-a901-4588-9ae8-712fbb11e1bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:02.317473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:02.318424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:02.319253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:02.323602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 324/645] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:02.325579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14ff33-05d0-4618-bb9a-84b2c24676bb None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.432566 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14ff33-05d0-4618-bb9a-84b2c24676bb None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.470253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.470868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.471148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.471422 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.472097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:02.472399 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:02.473794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:02.487573 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 322/646] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:02.489110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f8f3-a901-4588-9ae8-712fbb11e1bb None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.539167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:02.600780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f8f3-a901-4588-9ae8-712fbb11e1bb None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.637639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.638373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.638654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.638921 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.650151 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:02.651608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:02.667787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:02.669285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:02.670243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:02.670243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:02.670243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:02.672605 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 325/647] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:02.675235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.714362 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:02.790420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4731-4cfa-422e-ac26-6da9f9cef627 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.826846 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.827463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.827745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.828016 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.828666 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:02.828966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:02.830365 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:02.848589 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 323/648] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:02.850178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.953836 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:02.959135 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb1d7-0454-45ff-8252-38a01ee9eb16 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.996682 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023f4b3-4526-456a-8934-621447c951f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.998019 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f4b3-4526-456a-8934-621447c951f2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.998019 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f4b3-4526-456a-8934-621447c951f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.998344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f4b3-4526-456a-8934-621447c951f2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.006983 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023f4b3-4526-456a-8934-621447c951f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.008565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023f4b3-4526-456a-8934-621447c951f2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-d023f4b3-4526-456a-8934-621447c951f2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:03.022716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:03.024391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:03.026257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:03.029523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 326/649] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:03.031064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:03.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b61a-68aa-48c6-8f68-9b9f16b2ce42 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.134607 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b61a-68aa-48c6-8f68-9b9f16b2ce42 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.134887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b61a-68aa-48c6-8f68-9b9f16b2ce42 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.136448 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:03.136665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 327/650] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:03.145468 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca22fc-dd28-4660-a997-4806d5cd3837 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.145840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca22fc-dd28-4660-a997-4806d5cd3837 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.146082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9aaa3-59cb-447b-a0b1-537346ececde None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:03.146328 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca22fc-dd28-4660-a997-4806d5cd3837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.165678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d2ca22fc-dd28-4660-a997-4806d5cd3837 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:03.166918 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d2ca22fc-dd28-4660-a997-4806d5cd3837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:03.192700 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:03.193806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.194211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.195386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:03.195697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.197805 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.223269 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 324/651] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 24 08:36:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:03.229473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:03.252568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 328/652] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:03 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:03.344874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca087f-fcc7-4ba5-a29b-5558562730e3 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:03.381315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:03.381986 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.382259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.382529 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.393603 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.395046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:03.411627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:03.414585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:03.417473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:03.417473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:03.417473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:03.417473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 325/653] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:03.425490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca22fc-dd28-4660-a997-4806d5cd3837 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:03.511032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:03.526362 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:03.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:03.533599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca22fc-dd28-4660-a997-4806d5cd3837 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:03.585924 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:03.586561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.586843 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.587116 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.588525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:03.588830 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.590707 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.613521 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 329/654] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:03.615902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:03.667727 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aa6f8-ffee-46f5-82bf-7b67debb8188 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:03.708079 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe841558-4cf0-4af0-b5ae-3afde8d23832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:03.708693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841558-4cf0-4af0-b5ae-3afde8d23832 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.708962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841558-4cf0-4af0-b5ae-3afde8d23832 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.709231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe841558-4cf0-4af0-b5ae-3afde8d23832 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.709928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe841558-4cf0-4af0-b5ae-3afde8d23832 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.711300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe841558-4cf0-4af0-b5ae-3afde8d23832 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.735766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 326/655] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:03 2022] POST /identity/v3/services => generated 241 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:03.735766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36540b-b59a-45f1-97f8-d47ac1660be7 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.735766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36540b-b59a-45f1-97f8-d47ac1660be7 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.735766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36540b-b59a-45f1-97f8-d47ac1660be7 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.735766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 327/656] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:03.741204 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98bc1c-408c-4c9a-9293-6db9e8be97ba None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.741535 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98bc1c-408c-4c9a-9293-6db9e8be97ba None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.742547 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98bc1c-408c-4c9a-9293-6db9e8be97ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.748531 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628381eb-fe3d-4e32-bd13-2865773d755c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:03.764918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-9e98bc1c-408c-4c9a-9293-6db9e8be97ba None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:03.766113 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-9e98bc1c-408c-4c9a-9293-6db9e8be97ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:03.808892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:03.810200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.810481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.810753 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.820810 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.822637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.826669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:03.840425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:03.841573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:03.842473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:03.842473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:03.842473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:03.842473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:03.842473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:03.842473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:03.842473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:03.842473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:03.843428 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 330/657] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:03.843541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:03.849899 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:03.865995 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 328/658] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:03 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:03.983310 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb95629-c5a5-4b86-b070-cd2934f87bbb None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:04.023440 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf61a4-740b-4542-8df1-37d4aa13e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:04.023979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf61a4-740b-4542-8df1-37d4aa13e4aa None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.024252 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf61a4-740b-4542-8df1-37d4aa13e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.024518 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf61a4-740b-4542-8df1-37d4aa13e4aa None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.025249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf61a4-740b-4542-8df1-37d4aa13e4aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:04.025614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf61a4-740b-4542-8df1-37d4aa13e4aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:04.027098 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf61a4-740b-4542-8df1-37d4aa13e4aa None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:04.042376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 331/659] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:04.048904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98bc1c-408c-4c9a-9293-6db9e8be97ba None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:04.078101 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe649-7d69-44eb-a13a-d87a108e9925 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.078328 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe649-7d69-44eb-a13a-d87a108e9925 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.078563 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe649-7d69-44eb-a13a-d87a108e9925 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.080255 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 332/660] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:04.086034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149ec0c-33cd-46f5-944e-baf83821fc08 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.086387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149ec0c-33cd-46f5-944e-baf83821fc08 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.086682 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149ec0c-33cd-46f5-944e-baf83821fc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.106720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d149ec0c-33cd-46f5-944e-baf83821fc08 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:04.108052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d149ec0c-33cd-46f5-944e-baf83821fc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:04.174282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:04.182392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98bc1c-408c-4c9a-9293-6db9e8be97ba None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:04.188089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 333/661] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:04 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:04.189137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149ec0c-33cd-46f5-944e-baf83821fc08 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:04.228832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d2ade-d767-423f-9b0b-2cae9f9fa841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:04.229896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2ade-d767-423f-9b0b-2cae9f9fa841 None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.230381 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2ade-d767-423f-9b0b-2cae9f9fa841 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.230885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d2ade-d767-423f-9b0b-2cae9f9fa841 None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/a351023812dd4bd2ad078374bab98b89/roles/db88f96efdbc48d0ba8ba4bab75d438d` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.234523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d2ade-d767-423f-9b0b-2cae9f9fa841 None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=a351023812dd4bd2ad078374bab98b89, role_id=db88f96efdbc48d0ba8ba4bab75d438d)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:04.236186 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d2ade-d767-423f-9b0b-2cae9f9fa841 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:04.253082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 329/662] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:04 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/a351023812dd4bd2ad078374bab98b89/roles/db88f96efdbc48d0ba8ba4bab75d438d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:04.342478 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149ec0c-33cd-46f5-944e-baf83821fc08 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:04.384948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:04.385628 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.385962 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.386288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.386955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:04.389197 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:04.399455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:04.400530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:04.401364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 334/663] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:04.407450 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d2ade-d767-423f-9b0b-2cae9f9fa841 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:04.474662 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:04.495640 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:04.537632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d2ade-d767-423f-9b0b-2cae9f9fa841 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:04.571228 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:04.581985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:04.582907 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.583363 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.583805 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.584654 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:04.585140 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:04.586743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:04.593131 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 330/664] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:04.599101 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:04.635312 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996bf2e-55bf-4005-a60b-9bc00e7badd2 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:04.682431 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:04.683582 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.683582 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.683772 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.684241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:04.685840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:04.695824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:04.696850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:04.697766 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 335/665] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 24 08:36:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:04.706708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:04.724339 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09c53-9c3d-4a8c-92e6-cb712a444b63 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:04.752179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:04.779597 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:04.780398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.780678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.780999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.781695 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:04.781999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:04.784464 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:04.792102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 331/666] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:04.846061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1693cd6-2bda-45cd-ae67-b67031680772 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:04.868873 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:04.893342 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:04.894397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:04.894827 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:04.895254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:04.896071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:04.896531 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:04.898161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:04.904945 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 336/667] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:04.911961 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:05.054345 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7cf2-13ef-4701-a902-c82760e8aa9e None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:05.094566 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:05.095183 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:05.095458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:05.095728 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:05.096419 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:05.096662 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:05.098062 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:05.103817 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 332/668] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:05.110490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:05.227497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7f3c-68e9-4a6e-a8ae-7bfcf8bdc8ed None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:05.266238 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e330d-666b-465e-ade2-f15a825fa8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:05.266900 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e330d-666b-465e-ade2-f15a825fa8f1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:05.267180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e330d-666b-465e-ade2-f15a825fa8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:05.267508 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e330d-666b-465e-ade2-f15a825fa8f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:05.268226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e330d-666b-465e-ade2-f15a825fa8f1 None admin] RBAC: Adding query filter params (interface=public, service_id=fc1aa3a355e044c6b4dbef6b454d3b60, region_id=RegionOne) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:05.268551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e330d-666b-465e-ade2-f15a825fa8f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:05.270000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e330d-666b-465e-ade2-f15a825fa8f1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:05.276665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 337/669] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 24 08:36:05 2022] GET /identity/v3/endpoints?service_id=fc1aa3a355e044c6b4dbef6b454d3b60&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:05.282612 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:05.340914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:05.403619 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda45e-65d3-4c1e-af64-48b587c5fb71 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:05.444422 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659af51-5bf4-42af-8938-b14624cbb08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:05.445047 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659af51-5bf4-42af-8938-b14624cbb08f None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:05.445304 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659af51-5bf4-42af-8938-b14624cbb08f None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:05.445585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659af51-5bf4-42af-8938-b14624cbb08f None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:05.446191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659af51-5bf4-42af-8938-b14624cbb08f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:05.447555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659af51-5bf4-42af-8938-b14624cbb08f None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:05.454363 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 333/670] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:05 2022] GET /identity/v3/services => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:36:06.108530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94f3d-12db-44b3-9237-fce95445e66d None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:06.109066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94f3d-12db-44b3-9237-fce95445e66d None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:06.109546 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94f3d-12db-44b3-9237-fce95445e66d None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:06.111282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 338/671] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:06.117807 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bc8b0-728e-43db-b91d-2cac9cb13571 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:06.118356 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bc8b0-728e-43db-b91d-2cac9cb13571 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:06.118828 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bc8b0-728e-43db-b91d-2cac9cb13571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:06.139766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-4f2bc8b0-728e-43db-b91d-2cac9cb13571 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:06.141322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4f2bc8b0-728e-43db-b91d-2cac9cb13571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:06.220734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 334/672] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:06 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:06.498745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb94f3d-12db-44b3-9237-fce95445e66d None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:06.554838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:06.618923 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb94f3d-12db-44b3-9237-fce95445e66d None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:06.656950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7aded-8ab9-4c10-94f8-81320e6992f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:06.657677 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7aded-8ab9-4c10-94f8-81320e6992f5 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:06.657953 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7aded-8ab9-4c10-94f8-81320e6992f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:06.658224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7aded-8ab9-4c10-94f8-81320e6992f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:06.658805 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7aded-8ab9-4c10-94f8-81320e6992f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:06.660167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7aded-8ab9-4c10-94f8-81320e6992f5 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-4ef7aded-8ab9-4c10-94f8-81320e6992f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:06.670031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:06.671217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:06.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 339/673] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:06.679215 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bc8b0-728e-43db-b91d-2cac9cb13571 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:06.723252 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:06.726290 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902041-a6fc-4962-b075-9db7de26f7ad None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:06.726614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902041-a6fc-4962-b075-9db7de26f7ad None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:06.726890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902041-a6fc-4962-b075-9db7de26f7ad None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:06.730310 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 340/674] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:06.735087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126ce4-deef-43fe-8f43-d2a0fec7a652 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:06.735366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126ce4-deef-43fe-8f43-d2a0fec7a652 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:06.735647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126ce4-deef-43fe-8f43-d2a0fec7a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:06.756593 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-82126ce4-deef-43fe-8f43-d2a0fec7a652 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:06.757744 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-82126ce4-deef-43fe-8f43-d2a0fec7a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:06.823879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bc8b0-728e-43db-b91d-2cac9cb13571 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:06.838378 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 341/675] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:06 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:06.873723 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:06.874651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:06.875084 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:06.875507 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:06.876296 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:06.876757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:06.878424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:06.884522 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 335/676] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:06.891268 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126ce4-deef-43fe-8f43-d2a0fec7a652 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:06.937103 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:07.008728 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126ce4-deef-43fe-8f43-d2a0fec7a652 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.043294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.043987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.044266 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.044532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.045172 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:07.045490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.046897 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.053012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 342/677] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:07.059822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.120129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.203980 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475ea1c-4e24-4f3d-8faf-dc0e919fd7f9 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.208732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:07.246264 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f53ae-4b69-442d-af19-597e811ba842 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.250704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:07.256168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf3c23-7a55-4779-91ea-6da34ec14aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.256789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3c23-7a55-4779-91ea-6da34ec14aee None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.257068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3c23-7a55-4779-91ea-6da34ec14aee None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3c23-7a55-4779-91ea-6da34ec14aee None admin] PATH_INFO: `/v3/endpoints` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.258088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf3c23-7a55-4779-91ea-6da34ec14aee None admin] RBAC: Adding query filter params (interface=public, service_id=005b96e1065449db878c5c5da27d3ad4, region_id=RegionOne) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:07.258417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf3c23-7a55-4779-91ea-6da34ec14aee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.259880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf3c23-7a55-4779-91ea-6da34ec14aee None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.275059 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 336/678] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/endpoints?service_id=005b96e1065449db878c5c5da27d3ad4&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:07.276172 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06b73-25f4-4785-a82d-efd3124197e3 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.276454 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06b73-25f4-4785-a82d-efd3124197e3 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.276727 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c06b73-25f4-4785-a82d-efd3124197e3 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.282775 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 337/679] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:07.282775 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06b73-25f4-4785-a82d-efd3124197e3 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.292929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d9465-682a-4a6b-bba9-851de3631b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.293591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9465-682a-4a6b-bba9-851de3631b46 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.293955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9465-682a-4a6b-bba9-851de3631b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.294730 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9465-682a-4a6b-bba9-851de3631b46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.304990 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d9465-682a-4a6b-bba9-851de3631b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-7c3d9465-682a-4a6b-bba9-851de3631b46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:07.310354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:07.311574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:07.312554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 343/680] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:07.313382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad8247-185a-405d-9d16-960b0f3f4b53 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.313382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad8247-185a-405d-9d16-960b0f3f4b53 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.313382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad8247-185a-405d-9d16-960b0f3f4b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.332020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-4bad8247-185a-405d-9d16-960b0f3f4b53 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:07.333190 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-4bad8247-185a-405d-9d16-960b0f3f4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:07.401465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c06b73-25f4-4785-a82d-efd3124197e3 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.406643 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 344/681] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:07 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:07.410307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad8247-185a-405d-9d16-960b0f3f4b53 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.449362 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8aee5-0d7e-4e93-b586-ee066ed92cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.450561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8aee5-0d7e-4e93-b586-ee066ed92cb2 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.451545 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8aee5-0d7e-4e93-b586-ee066ed92cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.451811 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8aee5-0d7e-4e93-b586-ee066ed92cb2 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.452419 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8aee5-0d7e-4e93-b586-ee066ed92cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.453951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8aee5-0d7e-4e93-b586-ee066ed92cb2 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.469993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 338/682] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/services => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:36:07.533146 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:07.541684 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad8247-185a-405d-9d16-960b0f3f4b53 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.582535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.583533 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.584011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.584479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.585384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:07.585864 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.587479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.597712 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 345/683] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:07.609518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8aee5-0d7e-4e93-b586-ee066ed92cb2 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.647303 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:07.691706 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.735680 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8aee5-0d7e-4e93-b586-ee066ed92cb2 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.785228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.786118 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.786449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.787221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.803074 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.805246 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.807414 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b2e3f-82d9-4f5f-bca9-be3fa683bc68 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:07.826291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:07.827332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:07.828247 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:07.828247 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:07.828247 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:07.828611 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 339/684] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:07.834867 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.852873 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577dcaf-6dd4-42f1-9631-86a60130c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.853541 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577dcaf-6dd4-42f1-9631-86a60130c0f7 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.853887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577dcaf-6dd4-42f1-9631-86a60130c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.854162 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577dcaf-6dd4-42f1-9631-86a60130c0f7 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.854865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577dcaf-6dd4-42f1-9631-86a60130c0f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.856374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577dcaf-6dd4-42f1-9631-86a60130c0f7 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.874306 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 346/685] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:07 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:07.875326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b080a7-c117-415c-ada2-fab95a9c8a39 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.875611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b080a7-c117-415c-ada2-fab95a9c8a39 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.875878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b080a7-c117-415c-ada2-fab95a9c8a39 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.877095 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 347/686] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:07.887136 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13051f-98b1-42f2-a895-10f92bf11e3e None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.887838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13051f-98b1-42f2-a895-10f92bf11e3e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.888302 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13051f-98b1-42f2-a895-10f92bf11e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.913509 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-0a13051f-98b1-42f2-a895-10f92bf11e3e None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:07.914906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-0a13051f-98b1-42f2-a895-10f92bf11e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:07.929791 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:07.970755 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:08.000244 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b89c42-7c1a-4c3a-accb-ec1de90a1018 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.030961 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 348/687] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:08.048308 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.048841 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.049115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.049378 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.050080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:08.050376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.051771 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.065557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 340/688] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:08.070847 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13051f-98b1-42f2-a895-10f92bf11e3e None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.178326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13051f-98b1-42f2-a895-10f92bf11e3e None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.216099 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.217058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.217507 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.217926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.226041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.227697 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:08.243475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:08.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:08.245769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:08.248017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 349/689] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:08.253641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.319721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.349822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:08.385352 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9c143-f4c2-4be7-b369-36fbb406f591 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.435477 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a51e72-9c24-45a6-9c8b-0680a985119f None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.437142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.438907 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.439389 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.439868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.440794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:08.441289 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.443007 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.471293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 341/690] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:08.480249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.480448 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.480532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.480532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.480532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.480532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.480532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.482249 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:08.492322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:08.493417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:08.494364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:08.498188 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 350/691] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:08.500989 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.594289 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:08.619007 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4d45-6cf7-414b-8954-13a1ee63beff None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.636824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4844-bc83-49f8-924e-4ce8713827a3 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.690984 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95534764-894e-4b0e-bb0c-62ec39962fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.692023 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.692636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.692924 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.693226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.693808 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95534764-894e-4b0e-bb0c-62ec39962fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.693974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:08.694117 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.694917 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95534764-894e-4b0e-bb0c-62ec39962fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.695459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.695958 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95534764-894e-4b0e-bb0c-62ec39962fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.701166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 351/692] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:08.706405 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.822585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201b19-c453-4b7b-b5a8-32b12c8330a0 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.835148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95534764-894e-4b0e-bb0c-62ec39962fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.839192 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95534764-894e-4b0e-bb0c-62ec39962fb1 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.844821 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:08.856096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:08.863742 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.864372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.864665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.864926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.865594 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:08.865897 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.867800 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.874888 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 352/693] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:08.882534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.005709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 342/694] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:36:09.007209 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95534764-894e-4b0e-bb0c-62ec39962fb1 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.045639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3639b4-ae03-4a03-8e12-9c4b58344b34 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.085940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57ad59-4e17-43ac-bb33-0f0cadb478d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.086716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57ad59-4e17-43ac-bb33-0f0cadb478d5 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.087013 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57ad59-4e17-43ac-bb33-0f0cadb478d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.087264 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57ad59-4e17-43ac-bb33-0f0cadb478d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.087922 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57ad59-4e17-43ac-bb33-0f0cadb478d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.089535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57ad59-4e17-43ac-bb33-0f0cadb478d5 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.121667 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 353/695] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:36:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:09.184145 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95534764-894e-4b0e-bb0c-62ec39962fb1 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.186141 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:09.248741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.250011 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.250499 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.250970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.273775 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.276567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:09.298502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:09.299537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:09.300463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:09.300463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:09.300463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:09.300463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 343/696] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:09.305709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57ad59-4e17-43ac-bb33-0f0cadb478d5 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.362404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:09.422921 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57ad59-4e17-43ac-bb33-0f0cadb478d5 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.459171 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.459779 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.460053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.460319 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.460952 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:09.461245 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.462668 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.476321 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 354/697] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:09.481718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.597867 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bd965-c8e0-4218-bd4b-ad598de3f6a2 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.634753 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.635798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.636307 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.636848 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.645013 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.647061 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:09.659520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:09.660487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:09.661366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:09.661366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:09.661366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:09.661366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:09.661366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:09.661366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:09.661366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:09.661366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:09.663832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 344/698] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:09.670708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.780413 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46befa-4114-4ebd-87b2-1730d94026a0 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.794701 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:09.822449 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe58b5-860e-4722-ac23-61d00d5c1d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.823073 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe58b5-860e-4722-ac23-61d00d5c1d80 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.823348 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe58b5-860e-4722-ac23-61d00d5c1d80 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.823614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe58b5-860e-4722-ac23-61d00d5c1d80 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.824324 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe58b5-860e-4722-ac23-61d00d5c1d80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:09.824622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe58b5-860e-4722-ac23-61d00d5c1d80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.826926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe58b5-860e-4722-ac23-61d00d5c1d80 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.839985 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 355/699] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:09.846540 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.860880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:09.923938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7c5d7-77a4-4b72-a7fb-b55b8dd74c80 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.924321 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7c5d7-77a4-4b72-a7fb-b55b8dd74c80 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.924480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7c5d7-77a4-4b72-a7fb-b55b8dd74c80 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.926138 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 356/700] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:09.932029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61a88-a487-4dae-aba9-368d4764e3bd None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.932315 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61a88-a487-4dae-aba9-368d4764e3bd None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.932574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61a88-a487-4dae-aba9-368d4764e3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.954445 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-7dc61a88-a487-4dae-aba9-368d4764e3bd None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:09.955646 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-7dc61a88-a487-4dae-aba9-368d4764e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:09.970333 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aee42e-7452-45fc-b0f9-3743142e70aa None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:10.019856 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a64b72-698c-4794-9ab6-52dbc2986172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:10.021390 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a64b72-698c-4794-9ab6-52dbc2986172 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:10.021852 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a64b72-698c-4794-9ab6-52dbc2986172 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:10.022292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a64b72-698c-4794-9ab6-52dbc2986172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:10.023435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a64b72-698c-4794-9ab6-52dbc2986172 None admin] RBAC: Adding query filter params (role.id=db88f96efdbc48d0ba8ba4bab75d438d, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=a351023812dd4bd2ad078374bab98b89) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:10.023888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a64b72-698c-4794-9ab6-52dbc2986172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:10.026230 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a64b72-698c-4794-9ab6-52dbc2986172 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:10.036026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 345/701] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/role_assignments?user.id=a351023812dd4bd2ad078374bab98b89&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=db88f96efdbc48d0ba8ba4bab75d438d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:10.053651 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 357/702] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:10.232064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222cac9-251d-48f4-8aba-1aecde0a5d27 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:10.232064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222cac9-251d-48f4-8aba-1aecde0a5d27 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:10.232379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222cac9-251d-48f4-8aba-1aecde0a5d27 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:10.235929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 346/703] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:10.240129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f505c-0a76-4780-ab8b-89ce6a2d94e5 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:10.240447 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f505c-0a76-4780-ab8b-89ce6a2d94e5 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:10.240724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f505c-0a76-4780-ab8b-89ce6a2d94e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:10.263133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-be0f505c-0a76-4780-ab8b-89ce6a2d94e5 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:10.264692 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-be0f505c-0a76-4780-ab8b-89ce6a2d94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:10.342051 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222cac9-251d-48f4-8aba-1aecde0a5d27 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:10.343029 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 358/704] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:10.434001 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:10.468230 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222cac9-251d-48f4-8aba-1aecde0a5d27 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:10.504898 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:10.505556 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:10.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:10.506166 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:10.506749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:10.508112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:10.517955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:10.518972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:10.519822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 347/705] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:10.525676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f505c-0a76-4780-ab8b-89ce6a2d94e5 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:10.558080 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:10.628101 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:10.633005 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f505c-0a76-4780-ab8b-89ce6a2d94e5 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:10.672353 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:10.673042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:10.673345 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:10.673628 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:10.674292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:10.674592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:10.675949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:10.687551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 359/706] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:10.688713 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:10.759935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a4c43-a1a3-468c-b786-62aea6ec2157 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:10.808177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:10.808836 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:10.809112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:10.810836 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:10.811731 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:10.813528 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:10.817543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:10.827338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b8a6-3bc4-4deb-97d5-df57af6595f6 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:10.829557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:10.830565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:10.831393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:10.836936 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 348/707] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:10.838165 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:10.842019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:10.882244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:10.883900 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:10.884385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:10.885091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:10.886376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:10.887120 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:10.888879 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:10.901353 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 360/708] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:10.904559 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:10.997633 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ade72d-2f31-4281-ac8d-eb849b829e87 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:11.045497 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:11.046538 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.047116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.047716 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.048626 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:11.049168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:11.050829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:11.050950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d343b4-c55c-4c40-966e-535cb9977b3a None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:11.057273 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 349/709] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:11.069187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:11.096558 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa8f3-7d8f-41b1-9dac-eeded6303633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:11.097169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa8f3-7d8f-41b1-9dac-eeded6303633 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.097485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa8f3-7d8f-41b1-9dac-eeded6303633 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.097735 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa8f3-7d8f-41b1-9dac-eeded6303633 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.098447 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aa8f3-7d8f-41b1-9dac-eeded6303633 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:11.099852 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aa8f3-7d8f-41b1-9dac-eeded6303633 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:11.157593 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 361/710] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:36:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:11.196476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:11.262155 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4d547-9307-4dfc-8f93-86b270f39fcd None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:11.335110 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8765d-d784-45e0-8915-59b43f8e4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:11.336012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8765d-d784-45e0-8915-59b43f8e4dbc None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.336435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8765d-d784-45e0-8915-59b43f8e4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.336849 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8765d-d784-45e0-8915-59b43f8e4dbc None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.337679 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8765d-d784-45e0-8915-59b43f8e4dbc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:11.338171 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8765d-d784-45e0-8915-59b43f8e4dbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:11.339720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8765d-d784-45e0-8915-59b43f8e4dbc None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:11.352250 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 350/711] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:11.362285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa8f3-7d8f-41b1-9dac-eeded6303633 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:11.395363 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:11.521258 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa8f3-7d8f-41b1-9dac-eeded6303633 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:11.579558 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:11.580180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.580461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.580736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.581461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] RBAC: Adding query filter params (interface=public, service_id=5a583ed71a334606a400dec1b847460f, region_id=RegionOne) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:11.581952 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:11.583309 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:11.588604 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcb3d-339b-4903-b04b-afe7657bf583 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.588604 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcb3d-339b-4903-b04b-afe7657bf583 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.588604 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcb3d-339b-4903-b04b-afe7657bf583 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.589705 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 351/712] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:11.597524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 362/713] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 24 08:36:11 2022] GET /identity/v3/endpoints?service_id=5a583ed71a334606a400dec1b847460f&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:11.599423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5180-ffed-4a1c-9202-666f80e57e1c None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.599944 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5180-ffed-4a1c-9202-666f80e57e1c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.600401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a5180-ffed-4a1c-9202-666f80e57e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.607664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:11.642736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-7f4a5180-ffed-4a1c-9202-666f80e57e1c None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:11.643943 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-7f4a5180-ffed-4a1c-9202-666f80e57e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:11.697589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:11.725892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a0007-8358-47de-8369-c4b8c35ca389 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:11.771566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48704a95-1731-4782-a95c-f956d79d955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:11.772543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48704a95-1731-4782-a95c-f956d79d955f None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.773069 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48704a95-1731-4782-a95c-f956d79d955f None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.773600 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48704a95-1731-4782-a95c-f956d79d955f None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.774411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48704a95-1731-4782-a95c-f956d79d955f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:11.775968 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48704a95-1731-4782-a95c-f956d79d955f None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:11.789754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 363/715] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:11 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:36:11.789966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 352/715] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:12.120697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a5180-ffed-4a1c-9202-666f80e57e1c None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.190556 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:12.239311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a5180-ffed-4a1c-9202-666f80e57e1c None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.301666 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c49040-6cda-47e7-aa42-317fe1650615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.302615 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c49040-6cda-47e7-aa42-317fe1650615 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.303034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c49040-6cda-47e7-aa42-317fe1650615 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.303434 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c49040-6cda-47e7-aa42-317fe1650615 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.304345 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c49040-6cda-47e7-aa42-317fe1650615 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:12.306670 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c49040-6cda-47e7-aa42-317fe1650615 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-01c49040-6cda-47e7-aa42-317fe1650615 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:12.320221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:12.321376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:12.322264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:12.326319 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 353/716] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:12.328982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48704a95-1731-4782-a95c-f956d79d955f None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.377742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267d65-00a3-412e-af61-1080b1833877 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.378080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267d65-00a3-412e-af61-1080b1833877 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.378485 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267d65-00a3-412e-af61-1080b1833877 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.381308 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 354/717] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:12.388774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8380-5512-49bc-8207-b6c96a43a4c6 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.389463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8380-5512-49bc-8207-b6c96a43a4c6 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.390039 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8380-5512-49bc-8207-b6c96a43a4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.423839 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-038c8380-5512-49bc-8207-b6c96a43a4c6 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:12.425829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-038c8380-5512-49bc-8207-b6c96a43a4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:12.458933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48704a95-1731-4782-a95c-f956d79d955f None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.498970 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.500201 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.500546 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.500894 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.502033 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:12.502632 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:12.504405 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:12.513544 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 364/718] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:12.518114 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.532697 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:12.537694 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 355/719] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:12.693370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169d616-2743-4db9-98b7-ab153940c204 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.739907 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.740828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.741262 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.741721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.742796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] RBAC: Adding query filter params (type=compute) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:12.743277 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:12.744881 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:12.751348 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 365/720] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:12.811680 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c8380-5512-49bc-8207-b6c96a43a4c6 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.874628 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:12.935525 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c8380-5512-49bc-8207-b6c96a43a4c6 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.973167 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.973771 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.974052 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.974324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] PATH_INFO: `/v3/services/image` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.974917 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:12.976290 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:12.986449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:12.987416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:12.988467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 356/721] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:12.995906 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:13.074174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.109223 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223176d-8437-4b01-87a7-2292ffffab5d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:13.160590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4919a85-6282-4fbf-98b3-0aa4bade5c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:13.161217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4919a85-6282-4fbf-98b3-0aa4bade5c7c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.161529 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4919a85-6282-4fbf-98b3-0aa4bade5c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.161803 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4919a85-6282-4fbf-98b3-0aa4bade5c7c None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.162440 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4919a85-6282-4fbf-98b3-0aa4bade5c7c None admin] RBAC: Adding query filter params (name=image) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:13.162740 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4919a85-6282-4fbf-98b3-0aa4bade5c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:13.164131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4919a85-6282-4fbf-98b3-0aa4bade5c7c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:13.169865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 366/722] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:13.175812 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:13.306273 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481149a-4156-4db6-bcce-f4fff92e9b04 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:13.322688 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.345601 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437beaf-ca72-4d5e-b640-2ae851bb8201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:13.346218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437beaf-ca72-4d5e-b640-2ae851bb8201 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.346496 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437beaf-ca72-4d5e-b640-2ae851bb8201 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.346763 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437beaf-ca72-4d5e-b640-2ae851bb8201 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.347448 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437beaf-ca72-4d5e-b640-2ae851bb8201 None admin] RBAC: Adding query filter params (type=image) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:13.347749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437beaf-ca72-4d5e-b640-2ae851bb8201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:13.349117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437beaf-ca72-4d5e-b640-2ae851bb8201 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:13.354268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 357/723] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:13.713272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184b22-1c92-4137-bffb-a93508606c6c None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.713997 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184b22-1c92-4137-bffb-a93508606c6c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.713997 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184b22-1c92-4137-bffb-a93508606c6c None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.715401 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 367/724] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:13.721315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad69563-48ae-4782-8b27-124152eace1b None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.721708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad69563-48ae-4782-8b27-124152eace1b None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.721944 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad69563-48ae-4782-8b27-124152eace1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.740753 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-dad69563-48ae-4782-8b27-124152eace1b None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:13.741983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-dad69563-48ae-4782-8b27-124152eace1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:13.827923 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 358/725] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:14.165537 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d184b22-1c92-4137-bffb-a93508606c6c None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.166810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d33ab-b8ba-4f1f-aaa7-fe152e9e1cbf None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.167357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d33ab-b8ba-4f1f-aaa7-fe152e9e1cbf None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.167871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d33ab-b8ba-4f1f-aaa7-fe152e9e1cbf None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.169541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 359/726] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:14.175229 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d7a9-5c1f-4b2d-b198-cd55f6631fac None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.175876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d7a9-5c1f-4b2d-b198-cd55f6631fac None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.176788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45d7a9-5c1f-4b2d-b198-cd55f6631fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.197481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-4f45d7a9-5c1f-4b2d-b198-cd55f6631fac None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:14.199145 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4f45d7a9-5c1f-4b2d-b198-cd55f6631fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:14.300720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d184b22-1c92-4137-bffb-a93508606c6c None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.301537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 360/727] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:14.333277 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.333980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.334256 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.334526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.335111 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.336466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.338459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:14.347511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:14.348590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:14.349592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 368/728] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:14.358657 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45d7a9-5c1f-4b2d-b198-cd55f6631fac None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.410687 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.479606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45d7a9-5c1f-4b2d-b198-cd55f6631fac None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.525117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.526245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.526721 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.527202 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.529100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:14.529672 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.532231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.541879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 361/729] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.548459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.613002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.685971 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd275a7-a5a9-4c52-b720-a79d1f46aad6 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.730398 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.732193 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.732631 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.733053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.733901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:14.734357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.736827 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.744047 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 369/730] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.750966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.751889 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88afac3-e37c-4415-b73b-f2dfc425d79d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.753527 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.791442 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290947-d944-4629-9211-7f64bc374877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.792435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290947-d944-4629-9211-7f64bc374877 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.792860 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290947-d944-4629-9211-7f64bc374877 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.793283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290947-d944-4629-9211-7f64bc374877 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.794193 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290947-d944-4629-9211-7f64bc374877 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.795753 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290947-d944-4629-9211-7f64bc374877 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-48290947-d944-4629-9211-7f64bc374877 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:14.805414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:14.806475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:14.807321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:14.810251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 362/731] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:14.816473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290947-d944-4629-9211-7f64bc374877 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.833409 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.897132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce88d6c-b966-4846-b297-1a4427b96dd4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.968514 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.969258 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.970006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.971525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] RBAC: Adding query filter params (interface=admin, service_id=005b96e1065449db878c5c5da27d3ad4, region_id=RegionOne) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:14.972313 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.974893 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.993404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 370/732] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/endpoints?service_id=005b96e1065449db878c5c5da27d3ad4&interface=admin®ion_id=RegionOne => generated 193 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:14.995213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.005709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290947-d944-4629-9211-7f64bc374877 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.074491 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.075649 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.076116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.076560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.077695 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:15.078288 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.081112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.097116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 363/733] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:15.098812 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.155109 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.155818 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f79ef-dcfb-4f31-923c-6127fe681bf1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.184855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.194580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14978f-f306-40bf-8664-94845a389f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.195205 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14978f-f306-40bf-8664-94845a389f11 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.195483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14978f-f306-40bf-8664-94845a389f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.195754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14978f-f306-40bf-8664-94845a389f11 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.196361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14978f-f306-40bf-8664-94845a389f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.197761 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14978f-f306-40bf-8664-94845a389f11 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.213475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 371/734] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/services => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:36:15.213475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95221e2-ed92-481a-aba8-d8e6b709799e None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.213475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95221e2-ed92-481a-aba8-d8e6b709799e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.213475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95221e2-ed92-481a-aba8-d8e6b709799e None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.213475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 372/735] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:15.214745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888415f-562c-480d-9fbb-7002335f8de2 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.215166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888415f-562c-480d-9fbb-7002335f8de2 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.216050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888415f-562c-480d-9fbb-7002335f8de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.248119 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-3888415f-562c-480d-9fbb-7002335f8de2 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:15.250056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-3888415f-562c-480d-9fbb-7002335f8de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:15.294914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fcac4-5c8a-4ffd-a93c-490c039b6df4 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.347569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.349475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 373/736] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:15.354240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.354832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.355319 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.356429 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:15.357057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.358911 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.366119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 364/737] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:15.373642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888415f-562c-480d-9fbb-7002335f8de2 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.533189 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888415f-562c-480d-9fbb-7002335f8de2 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.569470 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.589251 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a537a-d17f-4d95-8015-3f4ff8788848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.589989 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a537a-d17f-4d95-8015-3f4ff8788848 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.590266 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a537a-d17f-4d95-8015-3f4ff8788848 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.591383 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a537a-d17f-4d95-8015-3f4ff8788848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.591867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a537a-d17f-4d95-8015-3f4ff8788848 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.593298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a537a-d17f-4d95-8015-3f4ff8788848 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.620524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 374/738] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:36:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:15.632142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.703481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd222e-7fc9-47db-ba74-ace1d4450e72 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.703751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd222e-7fc9-47db-ba74-ace1d4450e72 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.704067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd222e-7fc9-47db-ba74-ace1d4450e72 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.707048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 375/739] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:15.711630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d076d-4d46-4935-8657-bd5115454a2e None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.711900 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d076d-4d46-4935-8657-bd5115454a2e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.712204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d076d-4d46-4935-8657-bd5115454a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.732309 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-4b6d076d-4d46-4935-8657-bd5115454a2e None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:15.733571 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-4b6d076d-4d46-4935-8657-bd5115454a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:15.791071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb1535-a31b-4f53-af4f-7cd90b94f3b9 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.813995 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.832245 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 376/740] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:15.853098 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbe72a-e1ec-48f8-a7c5-5584dc327f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.854536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbe72a-e1ec-48f8-a7c5-5584dc327f13 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.855299 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbe72a-e1ec-48f8-a7c5-5584dc327f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.856083 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbe72a-e1ec-48f8-a7c5-5584dc327f13 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.858408 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbe72a-e1ec-48f8-a7c5-5584dc327f13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.861086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbe72a-e1ec-48f8-a7c5-5584dc327f13 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.882953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 365/741] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:15 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:16.118123 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d076d-4d46-4935-8657-bd5115454a2e None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:16.229529 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d076d-4d46-4935-8657-bd5115454a2e None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:16.231881 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:16.279358 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321a86-ffaa-42c5-898f-d7ecd8920c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:16.279765 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321a86-ffaa-42c5-898f-d7ecd8920c25 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:16.279937 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321a86-ffaa-42c5-898f-d7ecd8920c25 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:16.280181 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321a86-ffaa-42c5-898f-d7ecd8920c25 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:16.280860 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29321a86-ffaa-42c5-898f-d7ecd8920c25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:16.282288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29321a86-ffaa-42c5-898f-d7ecd8920c25 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:16.302466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 377/742] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:16 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:17.587159 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0dd32-6def-472e-8bfe-253556b3a9f9 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:17.587721 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0dd32-6def-472e-8bfe-253556b3a9f9 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:17.587721 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0dd32-6def-472e-8bfe-253556b3a9f9 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:17.589331 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 366/743] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:17.595691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738b9b-0320-4833-8e2e-9493c62c0147 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:17.596632 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738b9b-0320-4833-8e2e-9493c62c0147 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:17.597212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738b9b-0320-4833-8e2e-9493c62c0147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:17.616397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-43738b9b-0320-4833-8e2e-9493c62c0147 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:17.618215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-43738b9b-0320-4833-8e2e-9493c62c0147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:17.697012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 378/744] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:17 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:17.982921 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0dd32-6def-472e-8bfe-253556b3a9f9 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:18.054892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdadd-a74c-40cb-b6db-061088743368 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.055210 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdadd-a74c-40cb-b6db-061088743368 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.055452 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdadd-a74c-40cb-b6db-061088743368 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.056909 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 379/745] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:18.062635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd796c1a-12df-4bf1-9039-9e6ede1684cd None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.062933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd796c1a-12df-4bf1-9039-9e6ede1684cd None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.063187 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd796c1a-12df-4bf1-9039-9e6ede1684cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.082407 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-cd796c1a-12df-4bf1-9039-9e6ede1684cd None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:18.083957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-cd796c1a-12df-4bf1-9039-9e6ede1684cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:18.120799 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0dd32-6def-472e-8bfe-253556b3a9f9 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:18.161486 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 380/746] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:18 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:18.171193 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c83a3-f29d-4d6c-aa67-b7010c189418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:18.172246 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c83a3-f29d-4d6c-aa67-b7010c189418 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.172739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c83a3-f29d-4d6c-aa67-b7010c189418 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.173219 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c83a3-f29d-4d6c-aa67-b7010c189418 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.174061 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c83a3-f29d-4d6c-aa67-b7010c189418 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:18.175692 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c83a3-f29d-4d6c-aa67-b7010c189418 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-fc4c83a3-f29d-4d6c-aa67-b7010c189418 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:18.187271 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:18.188417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:18.189321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.192511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 367/747] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:18.198475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd796c1a-12df-4bf1-9039-9e6ede1684cd None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:18.220024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:18.314791 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd796c1a-12df-4bf1-9039-9e6ede1684cd None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:18.328982 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af1a5-a14a-45ed-8796-9e164743f4f2 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.329305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af1a5-a14a-45ed-8796-9e164743f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.329560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733af1a5-a14a-45ed-8796-9e164743f4f2 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.331034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 368/748] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:18.336206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3286d-884f-4846-a075-767d3785a62e None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.336739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3286d-884f-4846-a075-767d3785a62e None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.337219 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3286d-884f-4846-a075-767d3785a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.355760 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:18.357347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.357347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.357673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.358162 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:18.358458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:18.359823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:18.360481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-31d3286d-884f-4846-a075-767d3785a62e None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:18.362651 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-31d3286d-884f-4846-a075-767d3785a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:18.365467 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 381/749] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:18.371385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:18.410551 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:18.462434 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 369/750] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:18 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:18.467854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3286d-884f-4846-a075-767d3785a62e None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:18.578738 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:18.602785 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248fa15-3df6-49f4-86c7-9d73d3165a29 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:18.610325 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3286d-884f-4846-a075-767d3785a62e None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:18.655284 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4410b-e76e-4a41-95a6-ee14c111a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:18.655911 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4410b-e76e-4a41-95a6-ee14c111a510 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.656184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4410b-e76e-4a41-95a6-ee14c111a510 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.656447 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4410b-e76e-4a41-95a6-ee14c111a510 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.656878 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:18.657068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4410b-e76e-4a41-95a6-ee14c111a510 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:18.657362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4410b-e76e-4a41-95a6-ee14c111a510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:18.657560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.657844 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.658115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.658741 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4410b-e76e-4a41-95a6-ee14c111a510 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:18.658846 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:18.660382 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:18.663504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING keystone.server.flask.common [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 24 08:36:18.664135 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 382/751] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:18.665100 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7790-9dac-4d36-be9e-868b32a64156 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.665376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7790-9dac-4d36-be9e-868b32a64156 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.665673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7790-9dac-4d36-be9e-868b32a64156 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.666969 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 383/752] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:18.670055 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7790-9dac-4d36-be9e-868b32a64156 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:18.688108 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.sql.core [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 08:36:18.688108 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:36:18.688108 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [parameters: {'id': '9d70bea2adef4f2eb707921ae1629908', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 08:36:18.688108 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88334) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-8bcf8033-f99f-4975-aaf3-4ad48d82513e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9d70bea2adef4f2eb707921ae1629908.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9d70bea2adef4f2eb707921ae1629908. Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:36:18.697895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result.read() Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 08:36:18.698732 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application yield resource Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise self.value Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application session.commit() Oct 24 08:36:18.699686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:36:18.700580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:36:18.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result.read() Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:36:18.702336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [parameters: {'id': '9d70bea2adef4f2eb707921ae1629908', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:18.704237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:18.706191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9d70bea2adef4f2eb707921ae1629908. Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 370/753] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Oct 24 08:36:18 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fcd44-7172-4b69-a3a9-04a7aaaa7ed6 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.708102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fcd44-7172-4b69-a3a9-04a7aaaa7ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.709854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fcd44-7172-4b69-a3a9-04a7aaaa7ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.712186 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:18.728895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-221fcd44-7172-4b69-a3a9-04a7aaaa7ed6 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:18.730410 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-221fcd44-7172-4b69-a3a9-04a7aaaa7ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:18.792169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7790-9dac-4d36-be9e-868b32a64156 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:18.809406 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 371/754] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:18 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:18.810356 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fcd44-7172-4b69-a3a9-04a7aaaa7ed6 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:18.831993 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776a02e-68ff-4287-a02e-52a601f56444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:18.832839 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a02e-68ff-4287-a02e-52a601f56444 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.832839 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a02e-68ff-4287-a02e-52a601f56444 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.833038 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776a02e-68ff-4287-a02e-52a601f56444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.833709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776a02e-68ff-4287-a02e-52a601f56444 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:18.835067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776a02e-68ff-4287-a02e-52a601f56444 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:18.857280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 384/755] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:36:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:18.858811 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776a02e-68ff-4287-a02e-52a601f56444 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:18.862717 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:18.948616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fcd44-7172-4b69-a3a9-04a7aaaa7ed6 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.003101 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.009213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.009889 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.010228 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.010500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.015052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776a02e-68ff-4287-a02e-52a601f56444 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.020272 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.022086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:19.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:19.037364 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:19.038329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 372/756] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:19.046061 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.067423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.068049 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.068326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.068593 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] PATH_INFO: `/v3/services/compute` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.069173 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.070585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:19.081685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:19.082788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:19.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 385/757] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:19.088578 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.161006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.164583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a72e8-8209-49a4-9940-6822734b23e8 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.200923 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.201602 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.201879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.202150 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.202822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] RBAC: Adding query filter params (name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:19.203121 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.203644 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0fd48-10fc-46c8-8b01-0ef830be34cc None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.204550 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.233474 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 373/758] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:19.233474 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.256892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.257879 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.258253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.259019 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.260062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:19.260466 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.262060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.269642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 386/759] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:19.275502 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.290835 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.362307 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef567c-937e-426d-a77b-93e762384775 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.417996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.418776 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.419055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.419327 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] PATH_INFO: `/v3/services/image` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.419929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.421345 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.424038 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae2673-7bb7-4228-9068-05e2eca56cc9 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:19.438789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:19.440818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:19.441902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:19.443766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 374/760] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/services/image => generated 86 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:19.449360 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.458592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.471605 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.472249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.472525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.472793 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.473486 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:19.473755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.475116 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.483546 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 387/761] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:19.489423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.594625 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3b5fc-2b3b-4496-8382-0181bab49b0c None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.612822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.631856 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ab133-695a-402f-8a68-7c60603780c4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.635985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.636730 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.638459 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.639256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] RBAC: Adding query filter params (name=image) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:19.639656 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.641182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.647120 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 375/762] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:19.655609 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.677003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.677635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.677898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.678164 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.678861 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] RBAC: Adding query filter params (interface=public, service_id=d798d66346cb4142a1b058eba23acf71, region_id=RegionOne) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:19.679161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.680616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.690473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 388/763] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/endpoints?service_id=d798d66346cb4142a1b058eba23acf71&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:19.696622 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.785069 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a073a18-218e-4a31-9297-983068836fb3 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.794411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.823622 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.824230 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.824492 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.824815 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.825652 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] RBAC: Adding query filter params (type=image) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:19.825953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.827752 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.841477 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 376/764] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:19.845595 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.877183 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afff48-9845-4e31-b976-7bf8b6b9e5e0 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.920980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab890b32-76dd-4e80-9700-f762cc284146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.922102 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890b32-76dd-4e80-9700-f762cc284146 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.922655 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890b32-76dd-4e80-9700-f762cc284146 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890b32-76dd-4e80-9700-f762cc284146 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.924091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab890b32-76dd-4e80-9700-f762cc284146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.925877 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab890b32-76dd-4e80-9700-f762cc284146 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.928325 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.942816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 389/765] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/services => generated 1957 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:36:19.997615 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484bf80-1a20-4a12-8e4c-a7dfe73798cf None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.038178 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6045194-1a84-427e-857e-da78cffc0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.038801 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6045194-1a84-427e-857e-da78cffc0893 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.039078 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6045194-1a84-427e-857e-da78cffc0893 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.039350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6045194-1a84-427e-857e-da78cffc0893 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.040065 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6045194-1a84-427e-857e-da78cffc0893 None admin] RBAC: Adding query filter params (interface=public, service_id=7af97bb420e244c68aedfe25ff0dfe98, region_id=RegionOne) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:20.040371 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6045194-1a84-427e-857e-da78cffc0893 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.041798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6045194-1a84-427e-857e-da78cffc0893 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.048332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 377/766] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/endpoints?service_id=7af97bb420e244c68aedfe25ff0dfe98&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:20.054323 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab890b32-76dd-4e80-9700-f762cc284146 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:20.176167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab890b32-76dd-4e80-9700-f762cc284146 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.194890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:20.217698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9d32-6fe7-4fd8-bc4b-947b4116bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.218587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9d32-6fe7-4fd8-bc4b-947b4116bb7d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.219034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9d32-6fe7-4fd8-bc4b-947b4116bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.219471 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9d32-6fe7-4fd8-bc4b-947b4116bb7d None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.220227 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9d32-6fe7-4fd8-bc4b-947b4116bb7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.221772 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9d32-6fe7-4fd8-bc4b-947b4116bb7d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.229573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 390/767] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:20 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:36:21.155700 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77275a-0cc5-4fd0-92a8-41b2137d56ce None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.156714 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77275a-0cc5-4fd0-92a8-41b2137d56ce None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.157200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77275a-0cc5-4fd0-92a8-41b2137d56ce None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.159030 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 378/768] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:21.165017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec6fc5-b6c8-42f8-b632-e31fb3da0051 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.165966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec6fc5-b6c8-42f8-b632-e31fb3da0051 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.166472 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec6fc5-b6c8-42f8-b632-e31fb3da0051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.187892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-84ec6fc5-b6c8-42f8-b632-e31fb3da0051 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:21.189644 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-84ec6fc5-b6c8-42f8-b632-e31fb3da0051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:21.265823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 391/769] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:21.537118 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77275a-0cc5-4fd0-92a8-41b2137d56ce None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:21.655859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77275a-0cc5-4fd0-92a8-41b2137d56ce None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:21.663291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:21.690947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201abd5b-f3b2-428a-a568-973ef7d79602 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.691276 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201abd5b-f3b2-428a-a568-973ef7d79602 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.691502 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201abd5b-f3b2-428a-a568-973ef7d79602 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.694157 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 392/770] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:21.694677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07142-55c5-43c3-a34d-37cd65c30e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:21.695335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07142-55c5-43c3-a34d-37cd65c30e6e None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.695580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07142-55c5-43c3-a34d-37cd65c30e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.695847 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07142-55c5-43c3-a34d-37cd65c30e6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.696945 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf07142-55c5-43c3-a34d-37cd65c30e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:21.698336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d91ff-7cc5-4b7e-8fb4-35265f7ea3ac None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.698453 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf07142-55c5-43c3-a34d-37cd65c30e6e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:21.698940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d91ff-7cc5-4b7e-8fb4-35265f7ea3ac None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.699419 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d91ff-7cc5-4b7e-8fb4-35265f7ea3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.701329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 379/771] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:21.706266 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07142-55c5-43c3-a34d-37cd65c30e6e None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:21.726326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-241d91ff-7cc5-4b7e-8fb4-35265f7ea3ac None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:21.727675 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-241d91ff-7cc5-4b7e-8fb4-35265f7ea3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:21.809875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 393/772] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:21.835533 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07142-55c5-43c3-a34d-37cd65c30e6e None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:21.871983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71278219-40a3-4708-9e94-041f28c5110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:21.872840 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278219-40a3-4708-9e94-041f28c5110f None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.873286 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278219-40a3-4708-9e94-041f28c5110f None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.873735 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278219-40a3-4708-9e94-041f28c5110f None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.874555 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71278219-40a3-4708-9e94-041f28c5110f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:21.876189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71278219-40a3-4708-9e94-041f28c5110f None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:21.908729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 380/773] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:21 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:22.098510 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d91ff-7cc5-4b7e-8fb4-35265f7ea3ac None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:22.146584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:22.214223 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d91ff-7cc5-4b7e-8fb4-35265f7ea3ac None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:22.254139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:22.254775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.255050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.255319 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.255973 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:22.257468 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:22.260154 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING keystone.server.flask.common [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 24 08:36:22.275087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.sql.core [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 08:36:22.275087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 08:36:22.275087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [parameters: {'user_id': 'cab4ba59ddc3440897248d9517796278', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 08:36:22.275087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88335) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:36:22.280200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e965ba-8879-457c-9e8f-47aeb1b706c7 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.280691 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e965ba-8879-457c-9e8f-47aeb1b706c7 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.280769 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e965ba-8879-457c-9e8f-47aeb1b706c7 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.282322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 381/774] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result.read() Oct 24 08:36:22.283350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:36:22.284184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application yield resource Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise self.value Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application session.commit() Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:36:22.285139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:36:22.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:36:22.286902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application result.read() Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:36:22.287719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cab4ba59ddc3440897248d9517796278', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:22.288599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 24 08:36:22.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 24 08:36:22.292011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 24 08:36:22.292011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 24 08:36:22.292011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:36:22.292011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:36:22.292011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 08:36:22.292011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.292011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 394/775] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Oct 24 08:36:22 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:22.292794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451370e-2a5e-4310-a02b-82db64e630c5 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.292794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451370e-2a5e-4310-a02b-82db64e630c5 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.292794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451370e-2a5e-4310-a02b-82db64e630c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.293158 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:22.311323 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-d451370e-2a5e-4310-a02b-82db64e630c5 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:22.312818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-d451370e-2a5e-4310-a02b-82db64e630c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:22.345235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:22.402010 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 382/776] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:22 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:22.415655 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704310f4-192a-48e1-a6fa-05c6b5958361 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:22.418259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:22.458346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da854c-d26b-4348-9f54-e61a84f92600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:22.458993 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da854c-d26b-4348-9f54-e61a84f92600 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.459265 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da854c-d26b-4348-9f54-e61a84f92600 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.459530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da854c-d26b-4348-9f54-e61a84f92600 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.468511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da854c-d26b-4348-9f54-e61a84f92600 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:22.470236 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da854c-d26b-4348-9f54-e61a84f92600 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-c6da854c-d26b-4348-9f54-e61a84f92600 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:22.483372 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:22.485075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.486376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 395/777] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:22.490308 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451370e-2a5e-4310-a02b-82db64e630c5 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:22.565510 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a41d8b-b030-4ad5-bc0e-051f4e329850 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.565865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a41d8b-b030-4ad5-bc0e-051f4e329850 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.566060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a41d8b-b030-4ad5-bc0e-051f4e329850 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.570664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 396/778] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:22.581038 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb31ab1-2ba0-4462-8e3f-77ad8809731a None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.581347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb31ab1-2ba0-4462-8e3f-77ad8809731a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.581613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb31ab1-2ba0-4462-8e3f-77ad8809731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.604390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-efb31ab1-2ba0-4462-8e3f-77ad8809731a None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:22.607276 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-efb31ab1-2ba0-4462-8e3f-77ad8809731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:22.611847 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451370e-2a5e-4310-a02b-82db64e630c5 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:22.657621 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:22.658142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.658417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.658680 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.659370 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:22.659689 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:22.661993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:22.688177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 397/779] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:22 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:22.701685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb31ab1-2ba0-4462-8e3f-77ad8809731a None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:22.717470 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 383/780] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Oct 24 08:36:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:22.818896 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:22.827160 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb31ab1-2ba0-4462-8e3f-77ad8809731a None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:22.867170 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:22.868071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.868346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.868614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.869203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:22.870700 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:22.880361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:22.881535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:22.883895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 398/781] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:22.890151 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:22.908858 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:22.988511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.014084 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c457e-3a7d-4c03-b7ce-121b37f39093 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.058488 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.059821 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.060128 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.060403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.061050 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:23.061352 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.063216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:23.069345 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 384/782] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:23.077281 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.112277 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d077dbf-0686-4f87-a2cd-a5ebdba22c38 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.149855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.150521 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.150741 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.151000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] PATH_INFO: `/v3/services/image` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.151568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.152988 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:23.161210 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:23.163848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:23.164837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:36:23.165736 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:23.167097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 399/783] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Oct 24 08:36:22 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:23.172424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.188146 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886ada0-665b-4f89-8964-ba6e7f2ac20b None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.200309 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:23.227739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.228347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.228627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.228899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.229565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:23.229873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.231950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:23.239016 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 385/784] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:23.245027 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.284899 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8277a0-0863-4d11-ae06-fbd759cf0b9c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.330125 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.331518 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.331796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.332067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.332690 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] RBAC: Adding query filter params (name=image) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:23.332986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.334367 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:23.341056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 400/785] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:23.346629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.364041 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8e90f-2c7e-4654-a168-70d6b8d446ef None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.402467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baadf0-ac69-4306-8305-6234ab7dd707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.403997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baadf0-ac69-4306-8305-6234ab7dd707 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.404477 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baadf0-ac69-4306-8305-6234ab7dd707 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.404748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baadf0-ac69-4306-8305-6234ab7dd707 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.405425 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baadf0-ac69-4306-8305-6234ab7dd707 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.406862 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baadf0-ac69-4306-8305-6234ab7dd707 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:23.424810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:23.435375 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 386/786] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:36:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:23.461371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:23.483234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74d482-1784-4718-bd27-7b416688f1e8 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.547108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12274ac-90c1-4f5b-a584-cefd1b984246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.547794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12274ac-90c1-4f5b-a584-cefd1b984246 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.548127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12274ac-90c1-4f5b-a584-cefd1b984246 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.548306 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12274ac-90c1-4f5b-a584-cefd1b984246 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.549002 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12274ac-90c1-4f5b-a584-cefd1b984246 None admin] RBAC: Adding query filter params (type=image) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:23.549272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12274ac-90c1-4f5b-a584-cefd1b984246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.550695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12274ac-90c1-4f5b-a584-cefd1b984246 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:23.558206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 401/787] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:23.564229 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baadf0-ac69-4306-8305-6234ab7dd707 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.695177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baadf0-ac69-4306-8305-6234ab7dd707 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.735146 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882de41a-14c1-444a-a66f-75f02e4c395e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.735892 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de41a-14c1-444a-a66f-75f02e4c395e None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.736118 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de41a-14c1-444a-a66f-75f02e4c395e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.736392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882de41a-14c1-444a-a66f-75f02e4c395e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.737472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882de41a-14c1-444a-a66f-75f02e4c395e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.738717 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882de41a-14c1-444a-a66f-75f02e4c395e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:23.763536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 387/788] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:36:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:24.305259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed764-27d3-47c5-b47b-606ac0e636aa None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.305849 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed764-27d3-47c5-b47b-606ac0e636aa None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.305849 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eed764-27d3-47c5-b47b-606ac0e636aa None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.307320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 402/789] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:24.314596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97de32b-281c-4221-94be-a50e76d53cdf None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.315179 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97de32b-281c-4221-94be-a50e76d53cdf None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.315746 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97de32b-281c-4221-94be-a50e76d53cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.337375 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-e97de32b-281c-4221-94be-a50e76d53cdf None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:24.338609 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-e97de32b-281c-4221-94be-a50e76d53cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:24.397234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:24.433501 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 388/790] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:24.730103 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eed764-27d3-47c5-b47b-606ac0e636aa None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.859529 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eed764-27d3-47c5-b47b-606ac0e636aa None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.897207 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f17e6d-8021-4d1b-b97a-11302afbfb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.899934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17e6d-8021-4d1b-b97a-11302afbfb81 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.899934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17e6d-8021-4d1b-b97a-11302afbfb81 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.899934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17e6d-8021-4d1b-b97a-11302afbfb81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.899934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f17e6d-8021-4d1b-b97a-11302afbfb81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:24.900960 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f17e6d-8021-4d1b-b97a-11302afbfb81 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:24.903478 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 403/791] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:24.909074 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97de32b-281c-4221-94be-a50e76d53cdf None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.019931 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97de32b-281c-4221-94be-a50e76d53cdf None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.056830 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a2d0-c5c5-494e-8ee2-db40f8b9ad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.057501 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a2d0-c5c5-494e-8ee2-db40f8b9ad16 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.057779 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a2d0-c5c5-494e-8ee2-db40f8b9ad16 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.058130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a2d0-c5c5-494e-8ee2-db40f8b9ad16 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.058804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964a2d0-c5c5-494e-8ee2-db40f8b9ad16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.060900 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964a2d0-c5c5-494e-8ee2-db40f8b9ad16 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.084948 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 389/792] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:24 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:25.895355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f12ee-e4e6-49d4-96ac-80181fbbd2db None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.895882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f12ee-e4e6-49d4-96ac-80181fbbd2db None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.896004 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f12ee-e4e6-49d4-96ac-80181fbbd2db None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.897313 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 404/793] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:25.903448 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3191-b0a3-4011-aae9-00655a9d81d7 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.903890 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3191-b0a3-4011-aae9-00655a9d81d7 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.904144 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b3191-b0a3-4011-aae9-00655a9d81d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.922864 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-e22b3191-b0a3-4011-aae9-00655a9d81d7 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:25.924072 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-e22b3191-b0a3-4011-aae9-00655a9d81d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:25.958586 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.009505 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 390/794] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:26.057129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765febd-a530-4186-affd-0beab097205c None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.057531 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765febd-a530-4186-affd-0beab097205c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.057735 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765febd-a530-4186-affd-0beab097205c None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.059135 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 405/795] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:26.064950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6602ae-74bf-4613-acde-e0aeacaf028b None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.065240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6602ae-74bf-4613-acde-e0aeacaf028b None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.065542 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6602ae-74bf-4613-acde-e0aeacaf028b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.084073 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-3a6602ae-74bf-4613-acde-e0aeacaf028b None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:26.085247 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-3a6602ae-74bf-4613-acde-e0aeacaf028b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:26.156205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 391/796] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:26.286316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765febd-a530-4186-affd-0beab097205c None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.302764 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.393385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765febd-a530-4186-affd-0beab097205c None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.428376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6602ae-74bf-4613-acde-e0aeacaf028b None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.428897 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1226333-22f6-4cb5-89f3-06f3f51726c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.429560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226333-22f6-4cb5-89f3-06f3f51726c1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.429839 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226333-22f6-4cb5-89f3-06f3f51726c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.430112 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226333-22f6-4cb5-89f3-06f3f51726c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.445147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1226333-22f6-4cb5-89f3-06f3f51726c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-b1226333-22f6-4cb5-89f3-06f3f51726c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:26.450474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:26.451523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:26.452356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 406/797] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:26.458463 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1226333-22f6-4cb5-89f3-06f3f51726c1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.541133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.547121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.547370 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6602ae-74bf-4613-acde-e0aeacaf028b None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.575729 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1226333-22f6-4cb5-89f3-06f3f51726c1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.583373 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.584071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.584351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.584617 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.585471 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.586672 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.594416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.sql.core [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:36:26.594416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:36:26.594416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [parameters: {'id': '9cc6028f569149bc974bfc4e1a7ee5c7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 08:36:26.594416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88334) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:36:26.601598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result.read() Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 08:36:26.602426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application yield resource Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise self.value Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application session.commit() Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:36:26.603369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:36:26.604315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:36:26.605205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application result.read() Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:36:26.607826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [parameters: {'id': '9cc6028f569149bc974bfc4e1a7ee5c7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 08:36:26.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:26.613091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 392/798] 10.222.0.23 () {60 vars in 1137 bytes} [Mon Oct 24 08:36:26 2022] POST /identity/v3/domains => generated 190 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:26.615480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.618564 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.619171 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.619456 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.619726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.620870 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.621136 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.623919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.638640 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 407/799] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:26.639912 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.715787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc735-8774-42cf-bd30-ff955bef3974 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.742663 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967515bd-25e2-45de-9188-5787982f7687 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.751541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.752175 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.752807 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.753088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.764912 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.766409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.779607 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.780242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.780570 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.780840 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:26.781022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:26.781967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:26.782859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:26.782859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:26.782859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:26.782859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 393/800] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:26.786322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.788581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.797606 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.799046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.806235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:26.816196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:26.817250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:26.818756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:26.818756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:26.818756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:26.818756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 408/801] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:26.823584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.907051 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977396b-1047-4251-b1fc-21c870bd7eb9 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.935769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322a314-726c-47eb-bca2-876b38990411 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.944940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.945695 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.945976 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.946248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.946921 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.947314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.948735 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.963049 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 394/802] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:26.982789 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.983431 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.983706 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.983975 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.984644 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.984963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.986406 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.001490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 409/803] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:27.007484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.088560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.123601 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c42fd-7e4f-4968-bc10-5de058d0c169 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.164976 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2eee9-0d0f-4e03-9af6-30a28e856546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.165681 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eee9-0d0f-4e03-9af6-30a28e856546 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.165955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eee9-0d0f-4e03-9af6-30a28e856546 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.166225 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2eee9-0d0f-4e03-9af6-30a28e856546 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.174532 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2eee9-0d0f-4e03-9af6-30a28e856546 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.176003 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2eee9-0d0f-4e03-9af6-30a28e856546 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-11f2eee9-0d0f-4e03-9af6-30a28e856546 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:27.189114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:27.190147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:27.191478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 395/804] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:27.198130 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.256535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.321152 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939bbe-c707-43d1-b16f-bf20d4a5de77 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.355462 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.356673 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.356949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.357220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.357966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:27.358268 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.359683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.377500 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 410/805] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:27.378332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a114-23d3-4602-bca0-75d268078c74 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.378614 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a114-23d3-4602-bca0-75d268078c74 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.378883 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a114-23d3-4602-bca0-75d268078c74 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 396/806] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:27.383136 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.385014 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1759b-37d3-44f9-a304-dd15e58fb2c9 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.385293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1759b-37d3-44f9-a304-dd15e58fb2c9 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.385589 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1759b-37d3-44f9-a304-dd15e58fb2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.403601 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-89e1759b-37d3-44f9-a304-dd15e58fb2c9 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:27.404801 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-89e1759b-37d3-44f9-a304-dd15e58fb2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:27.472162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 397/807] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:27.482908 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7ae6b-e824-4111-82dc-bc5706ee44fd None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.490398 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.518963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.519595 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.519868 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.520136 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.531058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.532487 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:27.547498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:27.548591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:27.549995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:27.549995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:27.549995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:27.549995 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 411/808] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:27.554320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1759b-37d3-44f9-a304-dd15e58fb2c9 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.615726 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.655251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1759b-37d3-44f9-a304-dd15e58fb2c9 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.688554 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.689156 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.689460 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.689729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.690366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:27.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.692028 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.703440 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 398/809] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:27.709200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.745175 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.807792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b21e-95ea-4c8f-b2f5-14eea8de2c2b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.841313 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.841990 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.842256 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.842520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.847768 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82074f-d470-4a9c-b720-c64f0f286ed9 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.849089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.850535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:27.862295 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:27.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:27.864503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 412/810] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:27.869715 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.874239 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.886045 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6061be-acc5-4845-bc4e-5fe075128f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.886675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6061be-acc5-4845-bc4e-5fe075128f64 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.886951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6061be-acc5-4845-bc4e-5fe075128f64 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.887292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6061be-acc5-4845-bc4e-5fe075128f64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.889951 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.899422 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6061be-acc5-4845-bc4e-5fe075128f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-bf6061be-acc5-4845-bc4e-5fe075128f64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:27.904310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:27.909472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:27.911000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 399/811] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:27.911690 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6061be-acc5-4845-bc4e-5fe075128f64 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.994437 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be58b-c227-42dc-9d5f-fc8e3939f0db None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.033374 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6061be-acc5-4845-bc4e-5fe075128f64 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.033606 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.034214 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.034487 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.034764 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.035444 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:28.035747 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.037167 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.049665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 413/812] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:28.055613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:28.071596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.072122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.072397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.072669 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.073337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:28.073664 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.075084 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.083719 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 400/813] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:28.089450 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:28.134271 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:28.136870 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:28.157675 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc62054-82bd-45c2-a66c-12fda3404b81 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.191345 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8ce82-785f-4b7f-b0be-38a2a79c3c42 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.191598 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd72bc-aa1b-4d64-afe8-04b2ed786dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.192154 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd72bc-aa1b-4d64-afe8-04b2ed786dfc None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.192431 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd72bc-aa1b-4d64-afe8-04b2ed786dfc None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.192700 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd72bc-aa1b-4d64-afe8-04b2ed786dfc None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/5ccd68808df34afb9bc08db5bdd6afa9/roles/db88f96efdbc48d0ba8ba4bab75d438d` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.194868 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd72bc-aa1b-4d64-afe8-04b2ed786dfc None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=5ccd68808df34afb9bc08db5bdd6afa9, role_id=db88f96efdbc48d0ba8ba4bab75d438d)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.196288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd72bc-aa1b-4d64-afe8-04b2ed786dfc None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.209506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 414/814] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:28 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/5ccd68808df34afb9bc08db5bdd6afa9/roles/db88f96efdbc48d0ba8ba4bab75d438d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:36:28.234637 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7591-a7df-419c-bee9-0ef381075c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.235301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7591-a7df-419c-bee9-0ef381075c99 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.235578 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7591-a7df-419c-bee9-0ef381075c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.235850 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7591-a7df-419c-bee9-0ef381075c99 None admin] PATH_INFO: `/v3/users/9b6c64442a214a47a38077405bf0c253` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.252447 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f7591-a7df-419c-bee9-0ef381075c99 None admin] RBAC: Authorizing `identity:get_user(user_id=9b6c64442a214a47a38077405bf0c253)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.253995 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f7591-a7df-419c-bee9-0ef381075c99 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.255786 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 401/815] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:28 2022] GET /identity/v3/users/9b6c64442a214a47a38077405bf0c253 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:28.262976 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd72bc-aa1b-4d64-afe8-04b2ed786dfc None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:28.374905 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd72bc-aa1b-4d64-afe8-04b2ed786dfc None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.412301 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08418f1-62b5-48a1-980e-33933c0af9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.412932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08418f1-62b5-48a1-980e-33933c0af9b0 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.413206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08418f1-62b5-48a1-980e-33933c0af9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.413508 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08418f1-62b5-48a1-980e-33933c0af9b0 None admin] PATH_INFO: `/v3/projects/143aa4005ec546bfbddba23c8d82e718` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.414618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08418f1-62b5-48a1-980e-33933c0af9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=143aa4005ec546bfbddba23c8d82e718)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.416028 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08418f1-62b5-48a1-980e-33933c0af9b0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.417743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 415/816] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:28 2022] GET /identity/v3/projects/143aa4005ec546bfbddba23c8d82e718 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:28.423629 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7591-a7df-419c-bee9-0ef381075c99 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:28.524229 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7591-a7df-419c-bee9-0ef381075c99 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.525863 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:28.561095 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceccfaa-d9c8-4aa4-be4a-f348b8118680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.561788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceccfaa-d9c8-4aa4-be4a-f348b8118680 None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.562066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceccfaa-d9c8-4aa4-be4a-f348b8118680 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.562336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceccfaa-d9c8-4aa4-be4a-f348b8118680 None admin] PATH_INFO: `/v3/projects/143aa4005ec546bfbddba23c8d82e718/users/9b6c64442a214a47a38077405bf0c253/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.564206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceccfaa-d9c8-4aa4-be4a-f348b8118680 None admin] RBAC: Authorizing `identity:create_grant(project_id=143aa4005ec546bfbddba23c8d82e718, user_id=9b6c64442a214a47a38077405bf0c253, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.565653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceccfaa-d9c8-4aa4-be4a-f348b8118680 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.580305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 402/817] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:28 2022] PUT /identity/v3/projects/143aa4005ec546bfbddba23c8d82e718/users/9b6c64442a214a47a38077405bf0c253/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:30.427160 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79b3aa-46b8-47ee-abdf-0d11889f7bb8 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.427698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79b3aa-46b8-47ee-abdf-0d11889f7bb8 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.427698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79b3aa-46b8-47ee-abdf-0d11889f7bb8 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.429018 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 416/818] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:30.435409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58692c0-d813-42a9-a92f-34691f563005 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.435850 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58692c0-d813-42a9-a92f-34691f563005 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.435942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58692c0-d813-42a9-a92f-34691f563005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.455079 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-f58692c0-d813-42a9-a92f-34691f563005 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:30.456253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f58692c0-d813-42a9-a92f-34691f563005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:30.522131 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 403/819] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:30.780649 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4769991-1f36-4d83-982c-a63594b6b1b1 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.780927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4769991-1f36-4d83-982c-a63594b6b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.781190 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4769991-1f36-4d83-982c-a63594b6b1b1 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.782540 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 417/820] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:30.788063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13083e6-8021-4392-b31e-27d9e5bbac90 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.788420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13083e6-8021-4392-b31e-27d9e5bbac90 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.788791 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13083e6-8021-4392-b31e-27d9e5bbac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.791808 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4769991-1f36-4d83-982c-a63594b6b1b1 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:30.802417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:30.807751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-f13083e6-8021-4392-b31e-27d9e5bbac90 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:30.809005 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f13083e6-8021-4392-b31e-27d9e5bbac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:30.878358 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 404/821] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:30.905247 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4769991-1f36-4d83-982c-a63594b6b1b1 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.942498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66a090-5dff-47d6-9a30-8278e8feadef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:30.943221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66a090-5dff-47d6-9a30-8278e8feadef None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.943508 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66a090-5dff-47d6-9a30-8278e8feadef None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.943838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66a090-5dff-47d6-9a30-8278e8feadef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.956798 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66a090-5dff-47d6-9a30-8278e8feadef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-2a66a090-5dff-47d6-9a30-8278e8feadef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:30.962621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:30.963954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:30.966079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 418/822] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:30.971263 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13083e6-8021-4392-b31e-27d9e5bbac90 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.004387 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.157250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66a090-5dff-47d6-9a30-8278e8feadef None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.205204 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13083e6-8021-4392-b31e-27d9e5bbac90 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.224708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.241148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.241788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.242062 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.242334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.243289 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:31.243585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.244953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.253063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 405/823] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:31.259064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.260163 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66a090-5dff-47d6-9a30-8278e8feadef None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.295063 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83b10-b70e-4044-b775-ff251a86117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.295690 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83b10-b70e-4044-b775-ff251a86117e None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.295969 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83b10-b70e-4044-b775-ff251a86117e None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.296239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83b10-b70e-4044-b775-ff251a86117e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.306571 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83b10-b70e-4044-b775-ff251a86117e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-e0c83b10-b70e-4044-b775-ff251a86117e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:31.311350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.312322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:31.313213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 419/824] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:31.318381 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83b10-b70e-4044-b775-ff251a86117e None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.347676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.363269 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa275f-2882-4957-b473-5c5c674531e8 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.397058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.397720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.397996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.398269 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.409906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.411269 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.419942 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83b10-b70e-4044-b775-ff251a86117e None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:31.426580 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.427523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:31.428437 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:31.428437 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:31.428437 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:31.428437 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 406/825] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:31.433462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.446892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.456483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.457089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.457365 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.457670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.458323 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:31.458625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.459979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.468155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 420/826] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:31.473955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.537795 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd7bd-972e-4de8-8748-a724c2907987 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.572141 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.572743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.573022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.573198 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467ed8-1956-4056-b915-ce25412777e2 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.573303 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.573956 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:31.574256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.576216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.578563 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.588742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 407/827] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:31.595187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.607972 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d08822-afda-4d98-8686-81569ed6c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.608602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d08822-afda-4d98-8686-81569ed6c925 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.608878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d08822-afda-4d98-8686-81569ed6c925 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.609145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d08822-afda-4d98-8686-81569ed6c925 None admin] PATH_INFO: `/v3/users/9b6c64442a214a47a38077405bf0c253` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.610310 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d08822-afda-4d98-8686-81569ed6c925 None admin] RBAC: Authorizing `identity:get_user(user_id=9b6c64442a214a47a38077405bf0c253)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.611720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d08822-afda-4d98-8686-81569ed6c925 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.613288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 421/828] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/users/9b6c64442a214a47a38077405bf0c253 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:31.619207 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d08822-afda-4d98-8686-81569ed6c925 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.676391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.696002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880e70b-90ed-4cc3-9d65-b02009c6031d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.721248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d08822-afda-4d98-8686-81569ed6c925 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.729669 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.730566 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.730854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.740111 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.741567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:31.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.760058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 408/829] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:31.761261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.761957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff890d39-9e58-4ea1-9195-aa61dc358719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.763286 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff890d39-9e58-4ea1-9195-aa61dc358719 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.763564 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff890d39-9e58-4ea1-9195-aa61dc358719 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.763831 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff890d39-9e58-4ea1-9195-aa61dc358719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.817065 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.830378 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff890d39-9e58-4ea1-9195-aa61dc358719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.831823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff890d39-9e58-4ea1-9195-aa61dc358719 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.861400 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de856c-3408-44ac-aa98-d77227152cd6 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.886106 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.895683 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.896286 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.896570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.896868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.897623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:31.897927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.899359 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.917200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 409/830] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:31.924571 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.932676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 422/831] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 08:36:31.939054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff890d39-9e58-4ea1-9195-aa61dc358719 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.039096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4988d-a8a4-471d-aa43-6fdccaddf984 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.045522 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff890d39-9e58-4ea1-9195-aa61dc358719 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.053869 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.074464 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721b384-234e-4172-9ae1-73c30ea82033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.076134 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721b384-234e-4172-9ae1-73c30ea82033 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.076407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721b384-234e-4172-9ae1-73c30ea82033 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.076667 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721b384-234e-4172-9ae1-73c30ea82033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.079219 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87031b-4c0e-4a12-8dd7-9ba3dc1517b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.079851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87031b-4c0e-4a12-8dd7-9ba3dc1517b2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.080129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87031b-4c0e-4a12-8dd7-9ba3dc1517b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.080396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87031b-4c0e-4a12-8dd7-9ba3dc1517b2 None admin] PATH_INFO: `/v3/projects/143aa4005ec546bfbddba23c8d82e718` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.081533 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87031b-4c0e-4a12-8dd7-9ba3dc1517b2 None admin] RBAC: Authorizing `identity:get_project(project_id=143aa4005ec546bfbddba23c8d82e718)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.082939 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87031b-4c0e-4a12-8dd7-9ba3dc1517b2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.084549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 423/832] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/projects/143aa4005ec546bfbddba23c8d82e718 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.091245 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87031b-4c0e-4a12-8dd7-9ba3dc1517b2 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.115378 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.145036 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721b384-234e-4172-9ae1-73c30ea82033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.146509 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721b384-234e-4172-9ae1-73c30ea82033 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.190869 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87031b-4c0e-4a12-8dd7-9ba3dc1517b2 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.223794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.224388 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.224657 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.224926 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.225661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=143aa4005ec546bfbddba23c8d82e718, user.id=9b6c64442a214a47a38077405bf0c253) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.225966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.227370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.233693 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 424/833] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/role_assignments?user.id=9b6c64442a214a47a38077405bf0c253&scope.project.id=143aa4005ec546bfbddba23c8d82e718&role.id=ebf9799815574909aa1c88e93e213c96 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:32.245749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 410/834] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 08:36:32.253326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.349538 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.363363 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeab15-78fc-449f-9462-c9b6e9ef7605 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.399849 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.400491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.400760 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.401027 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.412517 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.413981 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:32.428086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:32.429108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:32.430041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:32.430041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:32.430041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:32.430041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 425/835] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:32.435542 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721b384-234e-4172-9ae1-73c30ea82033 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.451438 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.534049 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721b384-234e-4172-9ae1-73c30ea82033 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.567568 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.568198 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.568421 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.568684 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.569317 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.569645 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.570991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.582346 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 411/836] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.587722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.690413 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736fdf3-f0ed-40a7-a546-1150b91ab3de None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.723300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.723848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.724119 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.724382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.731168 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.732675 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.735165 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:32.744980 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:32.746177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:32.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:32.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:32.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:32.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:32.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:32.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:32.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:32.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:32.749591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 426/837] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:32.752724 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.829696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.855247 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a633b7-b8c3-4cf4-9bfb-eb2d6ada6e02 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.889420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48fbed-4e8e-4b85-8305-503a4c4ea724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.890046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fbed-4e8e-4b85-8305-503a4c4ea724 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.890321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fbed-4e8e-4b85-8305-503a4c4ea724 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.890588 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fbed-4e8e-4b85-8305-503a4c4ea724 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.891278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48fbed-4e8e-4b85-8305-503a4c4ea724 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.891579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48fbed-4e8e-4b85-8305-503a4c4ea724 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.892992 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48fbed-4e8e-4b85-8305-503a4c4ea724 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.905788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 412/838] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.912149 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.021493 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de34e-1cd2-4351-a6e6-7e0ea7b5dedd None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.058492 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dc83c-442d-4f15-b24c-c1c9769ca71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.059148 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc83c-442d-4f15-b24c-c1c9769ca71e None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.059478 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc83c-442d-4f15-b24c-c1c9769ca71e None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.059694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc83c-442d-4f15-b24c-c1c9769ca71e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.060439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dc83c-442d-4f15-b24c-c1c9769ca71e None admin] RBAC: Adding query filter params (role.id=db88f96efdbc48d0ba8ba4bab75d438d, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=5ccd68808df34afb9bc08db5bdd6afa9) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:33.060790 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dc83c-442d-4f15-b24c-c1c9769ca71e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.062224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dc83c-442d-4f15-b24c-c1c9769ca71e None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.068852 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 427/839] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/role_assignments?user.id=5ccd68808df34afb9bc08db5bdd6afa9&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=db88f96efdbc48d0ba8ba4bab75d438d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:34.448169 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07aacf-d2f5-4be6-835f-4f497fee1b5d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.448697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07aacf-d2f5-4be6-835f-4f497fee1b5d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.448697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07aacf-d2f5-4be6-835f-4f497fee1b5d None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.450066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 413/840] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:34.455467 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35097d7f-a68d-4107-bd30-5c3e46fb7a58 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.455845 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35097d7f-a68d-4107-bd30-5c3e46fb7a58 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.456015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35097d7f-a68d-4107-bd30-5c3e46fb7a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.473672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-35097d7f-a68d-4107-bd30-5c3e46fb7a58 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:34.474842 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-35097d7f-a68d-4107-bd30-5c3e46fb7a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:34.533868 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:34.550107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 428/841] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:34.826294 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07aacf-d2f5-4be6-835f-4f497fee1b5d None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.928804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07aacf-d2f5-4be6-835f-4f497fee1b5d None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.973594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05b783-a7e8-4168-8463-6dcc941d6b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.974259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b783-a7e8-4168-8463-6dcc941d6b2d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.974540 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b783-a7e8-4168-8463-6dcc941d6b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.974806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b783-a7e8-4168-8463-6dcc941d6b2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.976002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05b783-a7e8-4168-8463-6dcc941d6b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.977485 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05b783-a7e8-4168-8463-6dcc941d6b2d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.979386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 414/842] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:34.989684 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35097d7f-a68d-4107-bd30-5c3e46fb7a58 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.091031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35097d7f-a68d-4107-bd30-5c3e46fb7a58 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.124389 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57c172-7db2-4045-ae83-59047a173d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.124991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c172-7db2-4045-ae83-59047a173d67 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.125270 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c172-7db2-4045-ae83-59047a173d67 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.125570 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c172-7db2-4045-ae83-59047a173d67 None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.126225 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57c172-7db2-4045-ae83-59047a173d67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.127645 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57c172-7db2-4045-ae83-59047a173d67 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.149028 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 429/843] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:34 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:37.348550 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111c2e-4d02-497f-b72a-757a65127eb3 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.349088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111c2e-4d02-497f-b72a-757a65127eb3 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.349088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111c2e-4d02-497f-b72a-757a65127eb3 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.350462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 415/844] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:37.356252 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9e17-3bc6-429b-86d9-275fdd637ebc None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.356690 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9e17-3bc6-429b-86d9-275fdd637ebc None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.356803 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9e17-3bc6-429b-86d9-275fdd637ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.375308 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-ee2b9e17-3bc6-429b-86d9-275fdd637ebc None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:37.376483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-ee2b9e17-3bc6-429b-86d9-275fdd637ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:37.420874 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:37.441318 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 430/845] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:37.711098 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111c2e-4d02-497f-b72a-757a65127eb3 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.714014 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:37.822606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111c2e-4d02-497f-b72a-757a65127eb3 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:37.860641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d574b2-c142-463a-8593-6e93588b694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:37.861277 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d574b2-c142-463a-8593-6e93588b694f None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.861583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d574b2-c142-463a-8593-6e93588b694f None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.861855 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d574b2-c142-463a-8593-6e93588b694f None admin] PATH_INFO: `/v3/roles/02120488143f46a0aeda93d292f562c5` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.863264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d574b2-c142-463a-8593-6e93588b694f None admin] RBAC: Authorizing `identity:get_role(role_id=02120488143f46a0aeda93d292f562c5)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:37.864636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d574b2-c142-463a-8593-6e93588b694f None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:37.866018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 416/846] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/roles/02120488143f46a0aeda93d292f562c5 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:37.872783 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9e17-3bc6-429b-86d9-275fdd637ebc None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.967634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9e17-3bc6-429b-86d9-275fdd637ebc None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.002546 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29acc6d-2798-4173-8ea0-971a6bc2bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.003164 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29acc6d-2798-4173-8ea0-971a6bc2bc94 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.003434 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29acc6d-2798-4173-8ea0-971a6bc2bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.003699 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29acc6d-2798-4173-8ea0-971a6bc2bc94 None admin] PATH_INFO: `/v3/users/276555367890416b989883cbc9316f9a` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.016666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29acc6d-2798-4173-8ea0-971a6bc2bc94 None admin] RBAC: Authorizing `identity:get_user(user_id=276555367890416b989883cbc9316f9a)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.018103 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29acc6d-2798-4173-8ea0-971a6bc2bc94 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.019681 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 431/847] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/users/276555367890416b989883cbc9316f9a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:38.025532 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d574b2-c142-463a-8593-6e93588b694f None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:38.093560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:38.123208 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d574b2-c142-463a-8593-6e93588b694f None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.155983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d9bfa-7739-4121-b636-0aa08126f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.156594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9bfa-7739-4121-b636-0aa08126f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.156863 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9bfa-7739-4121-b636-0aa08126f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.157138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d9bfa-7739-4121-b636-0aa08126f5c8 None admin] PATH_INFO: `/v3/projects/143aa4005ec546bfbddba23c8d82e718` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.158282 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d9bfa-7739-4121-b636-0aa08126f5c8 None admin] RBAC: Authorizing `identity:get_project(project_id=143aa4005ec546bfbddba23c8d82e718)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.159693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d9bfa-7739-4121-b636-0aa08126f5c8 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.161305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 417/848] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:38 2022] GET /identity/v3/projects/143aa4005ec546bfbddba23c8d82e718 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:38.167217 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29acc6d-2798-4173-8ea0-971a6bc2bc94 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:38.206904 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:38.266619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29acc6d-2798-4173-8ea0-971a6bc2bc94 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.300723 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9ce7-52d8-412b-92d2-b960a2047189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.301369 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9ce7-52d8-412b-92d2-b960a2047189 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.301670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9ce7-52d8-412b-92d2-b960a2047189 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.301939 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9ce7-52d8-412b-92d2-b960a2047189 None admin] PATH_INFO: `/v3/projects/143aa4005ec546bfbddba23c8d82e718/users/276555367890416b989883cbc9316f9a/roles/02120488143f46a0aeda93d292f562c5` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.304007 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9ce7-52d8-412b-92d2-b960a2047189 None admin] RBAC: Authorizing `identity:create_grant(project_id=143aa4005ec546bfbddba23c8d82e718, user_id=276555367890416b989883cbc9316f9a, role_id=02120488143f46a0aeda93d292f562c5)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.305407 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9ce7-52d8-412b-92d2-b960a2047189 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.318670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 432/849] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:38 2022] PUT /identity/v3/projects/143aa4005ec546bfbddba23c8d82e718/users/276555367890416b989883cbc9316f9a/roles/02120488143f46a0aeda93d292f562c5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:40.477198 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731679be-0b30-496d-b61b-74ae5bd38d13 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.477796 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731679be-0b30-496d-b61b-74ae5bd38d13 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.477796 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731679be-0b30-496d-b61b-74ae5bd38d13 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.479083 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 418/850] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:40.484904 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e707c7-89ab-4fc1-a421-446a92d59c69 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.485343 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e707c7-89ab-4fc1-a421-446a92d59c69 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.485476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e707c7-89ab-4fc1-a421-446a92d59c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.503755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-e0e707c7-89ab-4fc1-a421-446a92d59c69 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:40.504941 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e0e707c7-89ab-4fc1-a421-446a92d59c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:40.569916 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 433/851] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:40.840593 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731679be-0b30-496d-b61b-74ae5bd38d13 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.944951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731679be-0b30-496d-b61b-74ae5bd38d13 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.979560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548efd-2c4f-420c-b060-bc175bacf853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.980186 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548efd-2c4f-420c-b060-bc175bacf853 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.980461 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548efd-2c4f-420c-b060-bc175bacf853 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.980834 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32548efd-2c4f-420c-b060-bc175bacf853 None admin] PATH_INFO: `/v3/roles/02120488143f46a0aeda93d292f562c5` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.983363 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32548efd-2c4f-420c-b060-bc175bacf853 None admin] RBAC: Authorizing `identity:get_role(role_id=02120488143f46a0aeda93d292f562c5)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.984706 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32548efd-2c4f-420c-b060-bc175bacf853 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.986064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 419/852] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/roles/02120488143f46a0aeda93d292f562c5 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:40.991919 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e707c7-89ab-4fc1-a421-446a92d59c69 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:41.018717 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:41.090015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e707c7-89ab-4fc1-a421-446a92d59c69 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:41.122729 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b268e2-77a1-40ca-8af6-a61b567c52f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:41.123276 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b268e2-77a1-40ca-8af6-a61b567c52f0 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:41.123551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b268e2-77a1-40ca-8af6-a61b567c52f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:41.123818 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b268e2-77a1-40ca-8af6-a61b567c52f0 None admin] PATH_INFO: `/v3/users/276555367890416b989883cbc9316f9a` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:41.124914 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b268e2-77a1-40ca-8af6-a61b567c52f0 None admin] RBAC: Authorizing `identity:get_user(user_id=276555367890416b989883cbc9316f9a)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:41.126365 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b268e2-77a1-40ca-8af6-a61b567c52f0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:41.127932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 434/853] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/users/276555367890416b989883cbc9316f9a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:41.133793 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548efd-2c4f-420c-b060-bc175bacf853 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:41.143173 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:41.235139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32548efd-2c4f-420c-b060-bc175bacf853 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:41.269735 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c19a-3855-4c95-904b-157c5322e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:41.270338 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c19a-3855-4c95-904b-157c5322e908 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:41.270624 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c19a-3855-4c95-904b-157c5322e908 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:41.270890 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c19a-3855-4c95-904b-157c5322e908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:41.337938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3c19a-3855-4c95-904b-157c5322e908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:41.339368 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3c19a-3855-4c95-904b-157c5322e908 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:41.347892 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:41.439656 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 420/854] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:36:41.445582 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b268e2-77a1-40ca-8af6-a61b567c52f0 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:41.539310 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:41.546221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b268e2-77a1-40ca-8af6-a61b567c52f0 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:41.580309 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae419966-fbbb-49f1-a69e-1ad4de054edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:41.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419966-fbbb-49f1-a69e-1ad4de054edb None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:41.581211 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419966-fbbb-49f1-a69e-1ad4de054edb None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:41.581509 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae419966-fbbb-49f1-a69e-1ad4de054edb None admin] PATH_INFO: `/v3/projects/143aa4005ec546bfbddba23c8d82e718` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:41.582610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae419966-fbbb-49f1-a69e-1ad4de054edb None admin] RBAC: Authorizing `identity:get_project(project_id=143aa4005ec546bfbddba23c8d82e718)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:41.584022 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae419966-fbbb-49f1-a69e-1ad4de054edb None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:41.585668 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 435/855] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:41 2022] GET /identity/v3/projects/143aa4005ec546bfbddba23c8d82e718 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:41.592010 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c19a-3855-4c95-904b-157c5322e908 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:41.692156 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c19a-3855-4c95-904b-157c5322e908 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:41.700860 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:41.728094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13020cd-40d1-4953-a0e3-8fabfd7f5160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:41.728695 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13020cd-40d1-4953-a0e3-8fabfd7f5160 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:41.728972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13020cd-40d1-4953-a0e3-8fabfd7f5160 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:41.729240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13020cd-40d1-4953-a0e3-8fabfd7f5160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:41.729994 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13020cd-40d1-4953-a0e3-8fabfd7f5160 None admin] RBAC: Adding query filter params (role.id=02120488143f46a0aeda93d292f562c5, scope.project.id=143aa4005ec546bfbddba23c8d82e718, user.id=276555367890416b989883cbc9316f9a) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:41.730298 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13020cd-40d1-4953-a0e3-8fabfd7f5160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:41.731843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13020cd-40d1-4953-a0e3-8fabfd7f5160 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:41.737502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 421/856] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:41 2022] GET /identity/v3/role_assignments?user.id=276555367890416b989883cbc9316f9a&scope.project.id=143aa4005ec546bfbddba23c8d82e718&role.id=02120488143f46a0aeda93d292f562c5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:43.950913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21544749-4294-4186-a196-b7c512af419a None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.951445 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21544749-4294-4186-a196-b7c512af419a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.951445 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21544749-4294-4186-a196-b7c512af419a None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.952773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 436/857] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:43.958048 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65474-df65-44fd-a35d-fffe8738ff23 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.958463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65474-df65-44fd-a35d-fffe8738ff23 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.958596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65474-df65-44fd-a35d-fffe8738ff23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.977791 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-b6d65474-df65-44fd-a35d-fffe8738ff23 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:43.978821 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-b6d65474-df65-44fd-a35d-fffe8738ff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:44.047158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 422/858] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:44.318409 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21544749-4294-4186-a196-b7c512af419a None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.420752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21544749-4294-4186-a196-b7c512af419a None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.458661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2705e57-7959-435d-b0d7-c6d84b8357d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.459323 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2705e57-7959-435d-b0d7-c6d84b8357d4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.459556 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2705e57-7959-435d-b0d7-c6d84b8357d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.459828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2705e57-7959-435d-b0d7-c6d84b8357d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.460934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2705e57-7959-435d-b0d7-c6d84b8357d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.462381 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2705e57-7959-435d-b0d7-c6d84b8357d4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.463935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 437/859] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:44.470711 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d65474-df65-44fd-a35d-fffe8738ff23 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.571998 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.574944 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d65474-df65-44fd-a35d-fffe8738ff23 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.611978 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec7cc0-804e-4f37-8c1d-6857bd2ad4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.612594 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7cc0-804e-4f37-8c1d-6857bd2ad4cb None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.612868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7cc0-804e-4f37-8c1d-6857bd2ad4cb None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.613134 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7cc0-804e-4f37-8c1d-6857bd2ad4cb None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.613837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec7cc0-804e-4f37-8c1d-6857bd2ad4cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.615266 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec7cc0-804e-4f37-8c1d-6857bd2ad4cb None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.644132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 423/860] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:44 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:46.859206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a94a85-40e9-4817-aad6-c489e3ac2b34 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.859842 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a94a85-40e9-4817-aad6-c489e3ac2b34 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.859842 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a94a85-40e9-4817-aad6-c489e3ac2b34 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.861050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 438/861] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:46.866369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb523-5352-428c-b5f7-57276fd90371 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.866815 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb523-5352-428c-b5f7-57276fd90371 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.866916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb523-5352-428c-b5f7-57276fd90371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.888407 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-55feb523-5352-428c-b5f7-57276fd90371 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:46.889689 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-55feb523-5352-428c-b5f7-57276fd90371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:46.958940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 424/862] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:47.231566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a94a85-40e9-4817-aad6-c489e3ac2b34 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:47.263275 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:47.334382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a94a85-40e9-4817-aad6-c489e3ac2b34 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:47.366940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4a966-adbb-4128-b65e-e8702644c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:47.367561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a966-adbb-4128-b65e-e8702644c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.368097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a966-adbb-4128-b65e-e8702644c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.368365 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a966-adbb-4128-b65e-e8702644c6f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.369490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4a966-adbb-4128-b65e-e8702644c6f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:47.370905 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4a966-adbb-4128-b65e-e8702644c6f2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:47.373211 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 439/863] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:47.379107 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feb523-5352-428c-b5f7-57276fd90371 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:47.458730 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:47.478822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feb523-5352-428c-b5f7-57276fd90371 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:47.513710 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19354fa4-3e56-4d19-a032-7ce02b101ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:47.514315 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354fa4-3e56-4d19-a032-7ce02b101ac1 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.514658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354fa4-3e56-4d19-a032-7ce02b101ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.514941 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19354fa4-3e56-4d19-a032-7ce02b101ac1 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.515598 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354fa4-3e56-4d19-a032-7ce02b101ac1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:47.517007 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19354fa4-3e56-4d19-a032-7ce02b101ac1 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:47.538975 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 425/864] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:47 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:49.739948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e8e1-8870-47b6-8a2f-b4a9853f2128 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:49.740506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e8e1-8870-47b6-8a2f-b4a9853f2128 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:49.740506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e8e1-8870-47b6-8a2f-b4a9853f2128 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:49.741823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 440/865] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:49.749273 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f697-600e-4bc7-85b0-94dc48605972 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:49.749693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f697-600e-4bc7-85b0-94dc48605972 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:49.749853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f697-600e-4bc7-85b0-94dc48605972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:49.768693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-6518f697-600e-4bc7-85b0-94dc48605972 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:49.769889 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6518f697-600e-4bc7-85b0-94dc48605972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:49.836293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 426/866] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:50.109253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14e8e1-8870-47b6-8a2f-b4a9853f2128 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.203763 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.207991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14e8e1-8870-47b6-8a2f-b4a9853f2128 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.240900 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029f85-b9e2-4a02-a083-163cc18f9b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.241540 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029f85-b9e2-4a02-a083-163cc18f9b90 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.241819 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029f85-b9e2-4a02-a083-163cc18f9b90 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.242084 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029f85-b9e2-4a02-a083-163cc18f9b90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.252666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54029f85-b9e2-4a02-a083-163cc18f9b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-54029f85-b9e2-4a02-a083-163cc18f9b90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:50.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:50.258534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:36:50.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 441/867] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:50.264690 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518f697-600e-4bc7-85b0-94dc48605972 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.329084 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.364304 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518f697-600e-4bc7-85b0-94dc48605972 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.401276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.401907 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.402185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.402553 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.403225 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:50.403525 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.404888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.412919 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 427/868] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:50.419434 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029f85-b9e2-4a02-a083-163cc18f9b90 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.518781 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029f85-b9e2-4a02-a083-163cc18f9b90 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.552886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc12d-99b8-4015-a6bb-14f3642c8df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.553551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc12d-99b8-4015-a6bb-14f3642c8df6 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.553832 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc12d-99b8-4015-a6bb-14f3642c8df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.554105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc12d-99b8-4015-a6bb-14f3642c8df6 None admin] PATH_INFO: `/v3/users/4b461c5983a3411c9957995426250e92` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.567357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccc12d-99b8-4015-a6bb-14f3642c8df6 None admin] RBAC: Authorizing `identity:get_user(user_id=4b461c5983a3411c9957995426250e92)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.568788 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccc12d-99b8-4015-a6bb-14f3642c8df6 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.570418 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 442/869] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/users/4b461c5983a3411c9957995426250e92 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:50.576835 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.673785 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561a8ac-b26c-4909-a68f-35694f5f0b29 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.701143 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.707430 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e55a23-dfe0-4f24-9949-3e3b28d67728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.708044 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55a23-dfe0-4f24-9949-3e3b28d67728 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.708316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55a23-dfe0-4f24-9949-3e3b28d67728 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.708583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e55a23-dfe0-4f24-9949-3e3b28d67728 None admin] PATH_INFO: `/v3/projects/b4ea81c8372142f896327c3bab691068` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.709701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e55a23-dfe0-4f24-9949-3e3b28d67728 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ea81c8372142f896327c3bab691068)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.711112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e55a23-dfe0-4f24-9949-3e3b28d67728 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.712741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 428/870] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/projects/b4ea81c8372142f896327c3bab691068 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:50.719390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc12d-99b8-4015-a6bb-14f3642c8df6 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.738273 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.818591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc12d-99b8-4015-a6bb-14f3642c8df6 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.861472 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab05f-1923-4d4d-ab94-0253729064c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.862161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab05f-1923-4d4d-ab94-0253729064c2 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.862439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab05f-1923-4d4d-ab94-0253729064c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.862711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab05f-1923-4d4d-ab94-0253729064c2 None admin] PATH_INFO: `/v3/projects/b4ea81c8372142f896327c3bab691068/users/4b461c5983a3411c9957995426250e92/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.864690 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab05f-1923-4d4d-ab94-0253729064c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ea81c8372142f896327c3bab691068, user_id=4b461c5983a3411c9957995426250e92, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.866184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab05f-1923-4d4d-ab94-0253729064c2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.880828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 443/871] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:50 2022] PUT /identity/v3/projects/b4ea81c8372142f896327c3bab691068/users/4b461c5983a3411c9957995426250e92/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:53.054322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eeb53-2c7d-43c3-bab2-d1acbb0dae13 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.054885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eeb53-2c7d-43c3-bab2-d1acbb0dae13 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.054885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eeb53-2c7d-43c3-bab2-d1acbb0dae13 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.056227 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 429/872] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:53.062524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41520ef-6123-49b1-ab65-84a22e2220f4 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.063097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41520ef-6123-49b1-ab65-84a22e2220f4 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.063097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41520ef-6123-49b1-ab65-84a22e2220f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.082775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-f41520ef-6123-49b1-ab65-84a22e2220f4 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:53.083993 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f41520ef-6123-49b1-ab65-84a22e2220f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:53.154151 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 444/873] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:53.438511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eeb53-2c7d-43c3-bab2-d1acbb0dae13 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.540920 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eeb53-2c7d-43c3-bab2-d1acbb0dae13 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.575467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691bc62-b68b-40ce-be52-25bbabcd7640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.576095 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691bc62-b68b-40ce-be52-25bbabcd7640 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.576371 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691bc62-b68b-40ce-be52-25bbabcd7640 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.576636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691bc62-b68b-40ce-be52-25bbabcd7640 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.587332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691bc62-b68b-40ce-be52-25bbabcd7640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-9691bc62-b68b-40ce-be52-25bbabcd7640 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:53.592829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:53.593979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:36:53.595351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 430/874] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:53.600126 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41520ef-6123-49b1-ab65-84a22e2220f4 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.611204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.707661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41520ef-6123-49b1-ab65-84a22e2220f4 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.742325 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.743172 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.743442 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.743703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.744357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:53.744655 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.746047 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.754679 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 445/875] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:53.760781 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691bc62-b68b-40ce-be52-25bbabcd7640 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.832212 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.877472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691bc62-b68b-40ce-be52-25bbabcd7640 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.910734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad6802-adcf-448f-8450-76b78bf59089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.911357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6802-adcf-448f-8450-76b78bf59089 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.911630 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6802-adcf-448f-8450-76b78bf59089 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.911899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6802-adcf-448f-8450-76b78bf59089 None admin] PATH_INFO: `/v3/users/4b461c5983a3411c9957995426250e92` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.913026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad6802-adcf-448f-8450-76b78bf59089 None admin] RBAC: Authorizing `identity:get_user(user_id=4b461c5983a3411c9957995426250e92)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.914475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad6802-adcf-448f-8450-76b78bf59089 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.916065 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 431/876] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/users/4b461c5983a3411c9957995426250e92 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:53.923110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:54.000464 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:54.032666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8a0e1-d4b3-4efc-836a-4d18b25c8caf None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:54.067708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbff741-8ff8-4a3a-a048-c105a70ed58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:54.068415 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbff741-8ff8-4a3a-a048-c105a70ed58b None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:54.068573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbff741-8ff8-4a3a-a048-c105a70ed58b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:54.068843 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbff741-8ff8-4a3a-a048-c105a70ed58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:54.137628 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbff741-8ff8-4a3a-a048-c105a70ed58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:54.139072 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbff741-8ff8-4a3a-a048-c105a70ed58b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:54.206825 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:54.243222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 446/877] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:36:54.249886 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad6802-adcf-448f-8450-76b78bf59089 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:54.365164 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad6802-adcf-448f-8450-76b78bf59089 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:54.392762 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:54.401924 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df92aa-bbd3-472c-84fc-d1d926fd6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:54.403069 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df92aa-bbd3-472c-84fc-d1d926fd6525 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:54.404037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df92aa-bbd3-472c-84fc-d1d926fd6525 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:54.404310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df92aa-bbd3-472c-84fc-d1d926fd6525 None admin] PATH_INFO: `/v3/projects/b4ea81c8372142f896327c3bab691068` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:54.405486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df92aa-bbd3-472c-84fc-d1d926fd6525 None admin] RBAC: Authorizing `identity:get_project(project_id=b4ea81c8372142f896327c3bab691068)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:54.406906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df92aa-bbd3-472c-84fc-d1d926fd6525 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:54.408529 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 432/878] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:54 2022] GET /identity/v3/projects/b4ea81c8372142f896327c3bab691068 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:54.414952 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbff741-8ff8-4a3a-a048-c105a70ed58b None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:54.529380 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbff741-8ff8-4a3a-a048-c105a70ed58b None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:54.570708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747d142-cf71-4d25-a4e4-6e8a2e5a34aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:54.571322 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d142-cf71-4d25-a4e4-6e8a2e5a34aa None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:54.571596 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d142-cf71-4d25-a4e4-6e8a2e5a34aa None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:54.571864 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d142-cf71-4d25-a4e4-6e8a2e5a34aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:54.572599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747d142-cf71-4d25-a4e4-6e8a2e5a34aa None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=b4ea81c8372142f896327c3bab691068, user.id=4b461c5983a3411c9957995426250e92) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:54.572904 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747d142-cf71-4d25-a4e4-6e8a2e5a34aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:54.574612 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747d142-cf71-4d25-a4e4-6e8a2e5a34aa None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:54.582054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 447/879] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:54 2022] GET /identity/v3/role_assignments?user.id=4b461c5983a3411c9957995426250e92&scope.project.id=b4ea81c8372142f896327c3bab691068&role.id=ebf9799815574909aa1c88e93e213c96 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:56.889615 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2009-8c6f-4be1-a298-b28d8ec67e49 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.890447 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2009-8c6f-4be1-a298-b28d8ec67e49 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.890447 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2009-8c6f-4be1-a298-b28d8ec67e49 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.891747 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 433/880] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:56.898090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274de3af-1d8e-4a5d-8b99-9a9b0e2f1680 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.898823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274de3af-1d8e-4a5d-8b99-9a9b0e2f1680 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.898823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274de3af-1d8e-4a5d-8b99-9a9b0e2f1680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.917815 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-274de3af-1d8e-4a5d-8b99-9a9b0e2f1680 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:56.919591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-274de3af-1d8e-4a5d-8b99-9a9b0e2f1680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:56.948320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:57.000338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 448/881] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:57.546147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2009-8c6f-4be1-a298-b28d8ec67e49 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.735796 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2009-8c6f-4be1-a298-b28d8ec67e49 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.803024 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e49b02-0672-4e2e-a208-dfadedb15cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.803990 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49b02-0672-4e2e-a208-dfadedb15cd6 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.804499 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49b02-0672-4e2e-a208-dfadedb15cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.804989 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49b02-0672-4e2e-a208-dfadedb15cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.806130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e49b02-0672-4e2e-a208-dfadedb15cd6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.808815 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e49b02-0672-4e2e-a208-dfadedb15cd6 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.836793 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 434/882] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Oct 24 08:36:57 2022] POST /identity/v3/domains => generated 267 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:00.220904 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e72534-ffce-4f39-8460-ddc7488ad358 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:00.221462 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e72534-ffce-4f39-8460-ddc7488ad358 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:00.221462 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e72534-ffce-4f39-8460-ddc7488ad358 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:00.222853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 449/883] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:00.228243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0955c4-67d6-435c-9f52-05dca10425d5 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:00.228661 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0955c4-67d6-435c-9f52-05dca10425d5 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:00.228751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0955c4-67d6-435c-9f52-05dca10425d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:00.248483 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-1d0955c4-67d6-435c-9f52-05dca10425d5 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:00.249682 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-1d0955c4-67d6-435c-9f52-05dca10425d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:00.300370 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:00.320797 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 435/884] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:00.609026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e72534-ffce-4f39-8460-ddc7488ad358 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:00.710969 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e72534-ffce-4f39-8460-ddc7488ad358 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:00.745409 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16c2e2-c1bd-47bf-b73c-10e00634a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:00.746755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c2e2-c1bd-47bf-b73c-10e00634a360 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:00.747076 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c2e2-c1bd-47bf-b73c-10e00634a360 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:00.747343 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16c2e2-c1bd-47bf-b73c-10e00634a360 None admin] PATH_INFO: `/v3/domains/02c8da488512432691918a534a912481` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:00.758020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16c2e2-c1bd-47bf-b73c-10e00634a360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=02c8da488512432691918a534a912481)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:00.759568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16c2e2-c1bd-47bf-b73c-10e00634a360 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:00.761160 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 450/885] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Oct 24 08:37:00 2022] GET /identity/v3/domains/02c8da488512432691918a534a912481 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:00.767055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0955c4-67d6-435c-9f52-05dca10425d5 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:00.863282 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0955c4-67d6-435c-9f52-05dca10425d5 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:00.897334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d69613-15d1-45dc-a19d-e7c91d27db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:00.897970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69613-15d1-45dc-a19d-e7c91d27db7a None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:00.898247 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69613-15d1-45dc-a19d-e7c91d27db7a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:00.898512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69613-15d1-45dc-a19d-e7c91d27db7a None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:00.899175 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d69613-15d1-45dc-a19d-e7c91d27db7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:00.900601 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d69613-15d1-45dc-a19d-e7c91d27db7a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:00.928150 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 436/886] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:37:00 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:03.143750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb180dd-6b2f-40db-bb7f-fde68e60efff None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.144299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb180dd-6b2f-40db-bb7f-fde68e60efff None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.144299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb180dd-6b2f-40db-bb7f-fde68e60efff None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.145777 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 451/887] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:03.151099 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbbc3-3f7f-4e6b-aa18-771d38d24282 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.151493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbbc3-3f7f-4e6b-aa18-771d38d24282 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.151647 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cbbc3-3f7f-4e6b-aa18-771d38d24282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.170427 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-922cbbc3-3f7f-4e6b-aa18-771d38d24282 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:03.171624 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-922cbbc3-3f7f-4e6b-aa18-771d38d24282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:03.200638 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:03.240292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 437/888] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:03.513043 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb180dd-6b2f-40db-bb7f-fde68e60efff None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:03.539634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:03.616028 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb180dd-6b2f-40db-bb7f-fde68e60efff None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.649249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504c64-ac93-4c4d-80e4-1b390d17f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.649891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504c64-ac93-4c4d-80e4-1b390d17f4de None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504c64-ac93-4c4d-80e4-1b390d17f4de None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.650435 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504c64-ac93-4c4d-80e4-1b390d17f4de None admin] PATH_INFO: `/v3/domains/02c8da488512432691918a534a912481` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.651530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504c64-ac93-4c4d-80e4-1b390d17f4de None admin] RBAC: Authorizing `identity:get_domain(domain_id=02c8da488512432691918a534a912481)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.653584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504c64-ac93-4c4d-80e4-1b390d17f4de None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:03.655131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 452/889] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Oct 24 08:37:03 2022] GET /identity/v3/domains/02c8da488512432691918a534a912481 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:03.660954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cbbc3-3f7f-4e6b-aa18-771d38d24282 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:03.758577 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cbbc3-3f7f-4e6b-aa18-771d38d24282 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.791482 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82274dea-5775-4a66-94ac-96d44e99e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.792011 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274dea-5775-4a66-94ac-96d44e99e051 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.792284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274dea-5775-4a66-94ac-96d44e99e051 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.792551 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82274dea-5775-4a66-94ac-96d44e99e051 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.793904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82274dea-5775-4a66-94ac-96d44e99e051 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.795330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82274dea-5775-4a66-94ac-96d44e99e051 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:03.816523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 438/890] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:37:03 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:06.036867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf528585-836c-4b3f-9b9b-e1910651df6f None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.037387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf528585-836c-4b3f-9b9b-e1910651df6f None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.037387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf528585-836c-4b3f-9b9b-e1910651df6f None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.038748 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 453/891] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:06.044251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da337cd7-5d5d-4072-b91a-cc7a18f0c8d8 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.044667 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da337cd7-5d5d-4072-b91a-cc7a18f0c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.044792 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da337cd7-5d5d-4072-b91a-cc7a18f0c8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.065676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-da337cd7-5d5d-4072-b91a-cc7a18f0c8d8 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:06.066862 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-da337cd7-5d5d-4072-b91a-cc7a18f0c8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:06.085787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:06.142797 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 439/892] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:06.420978 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf528585-836c-4b3f-9b9b-e1910651df6f None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:06.513368 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:06.525461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf528585-836c-4b3f-9b9b-e1910651df6f None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:06.563655 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de3d7-1adf-4740-903d-abee42b861c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:06.564278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de3d7-1adf-4740-903d-abee42b861c7 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.564548 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de3d7-1adf-4740-903d-abee42b861c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.564810 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de3d7-1adf-4740-903d-abee42b861c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.575912 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892de3d7-1adf-4740-903d-abee42b861c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-892de3d7-1adf-4740-903d-abee42b861c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:06.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:06.581694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:37:06.582542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 454/893] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:06.587967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da337cd7-5d5d-4072-b91a-cc7a18f0c8d8 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:06.694401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da337cd7-5d5d-4072-b91a-cc7a18f0c8d8 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:06.731724 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:06.732328 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.732604 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.732871 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.733568 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:06.733864 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:06.735233 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:06.744476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 440/894] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:06.751255 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de3d7-1adf-4740-903d-abee42b861c7 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:06.858016 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de3d7-1adf-4740-903d-abee42b861c7 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:06.896594 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b95a-2ca6-426a-85e8-473d97adefd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:06.897285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b95a-2ca6-426a-85e8-473d97adefd6 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.897635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b95a-2ca6-426a-85e8-473d97adefd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.897977 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258b95a-2ca6-426a-85e8-473d97adefd6 None admin] PATH_INFO: `/v3/users/2b544477bb404771840623ecac548816` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.913236 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258b95a-2ca6-426a-85e8-473d97adefd6 None admin] RBAC: Authorizing `identity:get_user(user_id=2b544477bb404771840623ecac548816)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:06.914725 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258b95a-2ca6-426a-85e8-473d97adefd6 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:06.916440 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 455/895] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:06 2022] GET /identity/v3/users/2b544477bb404771840623ecac548816 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:06.923538 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:06.941209 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:07.037760 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045e1e-cde7-461e-a5e1-55c74c63bd34 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:07.074057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb5d31-7e77-4b41-af30-b7e94d9cfa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:07.074798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb5d31-7e77-4b41-af30-b7e94d9cfa8e None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:07.075189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb5d31-7e77-4b41-af30-b7e94d9cfa8e None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:07.075464 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb5d31-7e77-4b41-af30-b7e94d9cfa8e None admin] PATH_INFO: `/v3/projects/f6b4b9a64053476b83579749833cae63` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:07.076660 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb5d31-7e77-4b41-af30-b7e94d9cfa8e None admin] RBAC: Authorizing `identity:get_project(project_id=f6b4b9a64053476b83579749833cae63)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:07.078128 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb5d31-7e77-4b41-af30-b7e94d9cfa8e None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:07.079793 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 441/896] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:37:06 2022] GET /identity/v3/projects/f6b4b9a64053476b83579749833cae63 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:07.086105 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b95a-2ca6-426a-85e8-473d97adefd6 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:07.099868 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:07.192880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258b95a-2ca6-426a-85e8-473d97adefd6 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:07.228954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a5a0a-5a74-4384-8cf3-0139761f6cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:07.229555 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5a0a-5a74-4384-8cf3-0139761f6cd2 None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:07.229831 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5a0a-5a74-4384-8cf3-0139761f6cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:07.230099 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5a0a-5a74-4384-8cf3-0139761f6cd2 None admin] PATH_INFO: `/v3/projects/f6b4b9a64053476b83579749833cae63/users/2b544477bb404771840623ecac548816/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:07.232520 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a5a0a-5a74-4384-8cf3-0139761f6cd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6b4b9a64053476b83579749833cae63, user_id=2b544477bb404771840623ecac548816, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:07.234482 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a5a0a-5a74-4384-8cf3-0139761f6cd2 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:07.249992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 456/897] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:37:07 2022] PUT /identity/v3/projects/f6b4b9a64053476b83579749833cae63/users/2b544477bb404771840623ecac548816/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:37:09.479929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f11d-b709-4b21-b048-5a6fb13b34cb None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:09.480706 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f11d-b709-4b21-b048-5a6fb13b34cb None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:09.480706 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8f11d-b709-4b21-b048-5a6fb13b34cb None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:09.482324 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 442/898] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:09.488216 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb74396-7141-4856-b03d-1143839e05fa None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:09.488789 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb74396-7141-4856-b03d-1143839e05fa None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:09.488789 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb74396-7141-4856-b03d-1143839e05fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:09.509131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-dfb74396-7141-4856-b03d-1143839e05fa None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:09.510377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-dfb74396-7141-4856-b03d-1143839e05fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:09.580824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:09.586997 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 457/899] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:09.883112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8f11d-b709-4b21-b048-5a6fb13b34cb None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:10.008427 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:10.029831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8f11d-b709-4b21-b048-5a6fb13b34cb None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:10.068336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b419-fbb9-4467-93df-15cb95afcf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:10.069069 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b419-fbb9-4467-93df-15cb95afcf13 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:10.069353 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b419-fbb9-4467-93df-15cb95afcf13 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:10.069664 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b419-fbb9-4467-93df-15cb95afcf13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:10.082929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839b419-fbb9-4467-93df-15cb95afcf13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-7839b419-fbb9-4467-93df-15cb95afcf13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:10.087653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:10.088607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:37:10.090276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 443/900] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:37:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:10.095998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb74396-7141-4856-b03d-1143839e05fa None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:10.197121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb74396-7141-4856-b03d-1143839e05fa None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:10.233987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:10.234603 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:10.234876 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:10.235151 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:10.235820 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:10.236123 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:10.237542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:10.246898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 458/901] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:10.253403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b419-fbb9-4467-93df-15cb95afcf13 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:10.359441 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b419-fbb9-4467-93df-15cb95afcf13 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:10.395066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5f33-18a4-4932-9737-99871433be6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:10.395693 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5f33-18a4-4932-9737-99871433be6b None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:10.395969 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5f33-18a4-4932-9737-99871433be6b None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:10.396238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5f33-18a4-4932-9737-99871433be6b None admin] PATH_INFO: `/v3/users/2b544477bb404771840623ecac548816` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:10.397383 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5f33-18a4-4932-9737-99871433be6b None admin] RBAC: Authorizing `identity:get_user(user_id=2b544477bb404771840623ecac548816)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:10.398959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5f33-18a4-4932-9737-99871433be6b None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:10.400570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 444/902] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:10 2022] GET /identity/v3/users/2b544477bb404771840623ecac548816 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:10.406439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:10.468924 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:10.515145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b52a4-6034-44f1-8c9e-7d0932b8c5fa None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:10.550333 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f552344-7f8a-41f8-8c7d-76fe544ad38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:10.550949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552344-7f8a-41f8-8c7d-76fe544ad38a None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:10.551223 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552344-7f8a-41f8-8c7d-76fe544ad38a None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:10.551491 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552344-7f8a-41f8-8c7d-76fe544ad38a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:10.621585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f552344-7f8a-41f8-8c7d-76fe544ad38a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:10.623042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f552344-7f8a-41f8-8c7d-76fe544ad38a None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:10.687421 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:10.740952 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 459/903] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:37:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:37:10.747823 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5f33-18a4-4932-9737-99871433be6b None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:10.761154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:10.854511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5f33-18a4-4932-9737-99871433be6b None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:10.889145 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361543ee-5907-47c2-bf76-5f6548527c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:10.889807 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361543ee-5907-47c2-bf76-5f6548527c1a None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:10.890079 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361543ee-5907-47c2-bf76-5f6548527c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:10.890343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361543ee-5907-47c2-bf76-5f6548527c1a None admin] PATH_INFO: `/v3/projects/f6b4b9a64053476b83579749833cae63` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:10.891473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361543ee-5907-47c2-bf76-5f6548527c1a None admin] RBAC: Authorizing `identity:get_project(project_id=f6b4b9a64053476b83579749833cae63)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:10.892922 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361543ee-5907-47c2-bf76-5f6548527c1a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:10.894615 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 445/904] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Oct 24 08:37:10 2022] GET /identity/v3/projects/f6b4b9a64053476b83579749833cae63 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:10.900883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f552344-7f8a-41f8-8c7d-76fe544ad38a None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:11.006361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f552344-7f8a-41f8-8c7d-76fe544ad38a None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:11.043950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256bcde-1032-4b6a-ab21-a385a0e93189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:11.044549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256bcde-1032-4b6a-ab21-a385a0e93189 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.044827 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256bcde-1032-4b6a-ab21-a385a0e93189 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.045082 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256bcde-1032-4b6a-ab21-a385a0e93189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.045835 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256bcde-1032-4b6a-ab21-a385a0e93189 None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=f6b4b9a64053476b83579749833cae63, user.id=2b544477bb404771840623ecac548816) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:11.046157 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256bcde-1032-4b6a-ab21-a385a0e93189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:11.047597 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256bcde-1032-4b6a-ab21-a385a0e93189 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:11.053702 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 460/905] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:37:10 2022] GET /identity/v3/role_assignments?user.id=2b544477bb404771840623ecac548816&scope.project.id=f6b4b9a64053476b83579749833cae63&role.id=ebf9799815574909aa1c88e93e213c96 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:20.884112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=61 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:21.051315 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=87 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:13.800008 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e754ed9-983c-4c0a-8c95-0b8bb42976c1 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:13.800640 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e754ed9-983c-4c0a-8c95-0b8bb42976c1 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:13.800923 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e754ed9-983c-4c0a-8c95-0b8bb42976c1 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:13.803597 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 446/906] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:38:13.811587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099b205-6496-4c6d-b45c-0148004418f2 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:13.812560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099b205-6496-4c6d-b45c-0148004418f2 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:13.812560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099b205-6496-4c6d-b45c-0148004418f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:13.841309 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d099b205-6496-4c6d-b45c-0148004418f2 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:13.842720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d099b205-6496-4c6d-b45c-0148004418f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:14.008503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 461/907] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:14.410623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e754ed9-983c-4c0a-8c95-0b8bb42976c1 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:14.577873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e754ed9-983c-4c0a-8c95-0b8bb42976c1 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:14.628545 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:14.629229 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:14.629545 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:14.629834 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:14.644799 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:14.646349 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:14.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:14.669018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:14.671187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:14.671187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:14.671187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:14.671187 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 447/908] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:14.675315 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099b205-6496-4c6d-b45c-0148004418f2 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:14.937534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099b205-6496-4c6d-b45c-0148004418f2 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:15.021578 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:15.035787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a8ef7-c932-43ef-9d34-3d06cf84d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:15.037394 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8ef7-c932-43ef-9d34-3d06cf84d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:15.038264 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8ef7-c932-43ef-9d34-3d06cf84d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:15.039095 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8ef7-c932-43ef-9d34-3d06cf84d0e8 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:15.040438 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a8ef7-c932-43ef-9d34-3d06cf84d0e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:15.040929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a8ef7-c932-43ef-9d34-3d06cf84d0e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:15.044950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a8ef7-c932-43ef-9d34-3d06cf84d0e8 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:15.075061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 462/909] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:15.080787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:15.185165 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:15.291794 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc1dd-96dc-4e61-ab4e-6268c068c33c None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:15.339832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbac68-e37a-4492-90a9-374fcbe420da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:15.340814 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbac68-e37a-4492-90a9-374fcbe420da None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:15.341158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbac68-e37a-4492-90a9-374fcbe420da None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:15.341716 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbac68-e37a-4492-90a9-374fcbe420da None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:15.342750 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbac68-e37a-4492-90a9-374fcbe420da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:15.344434 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbac68-e37a-4492-90a9-374fcbe420da None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:15.379987 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 448/910] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Oct 24 08:38:15 2022] POST /identity/v3/users => generated 251 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:38:19.039897 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265b36-fc30-40a3-877a-eb009e3d9ec3 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:19.040517 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265b36-fc30-40a3-877a-eb009e3d9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:19.040778 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0265b36-fc30-40a3-877a-eb009e3d9ec3 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:19.043835 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 463/911] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:38:19.054565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775357d9-c946-4d74-9ad0-f93b21452660 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:19.055435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775357d9-c946-4d74-9ad0-f93b21452660 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:19.055600 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775357d9-c946-4d74-9ad0-f93b21452660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:19.082153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-775357d9-c946-4d74-9ad0-f93b21452660 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:19.084188 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-775357d9-c946-4d74-9ad0-f93b21452660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:19.200080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 449/912] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:19.502659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0265b36-fc30-40a3-877a-eb009e3d9ec3 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:19.722479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0265b36-fc30-40a3-877a-eb009e3d9ec3 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:19.796815 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78190-d4ba-4ea1-a5f5-dffaf3339f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:19.797872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78190-d4ba-4ea1-a5f5-dffaf3339f0d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:19.798306 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78190-d4ba-4ea1-a5f5-dffaf3339f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:19.798704 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78190-d4ba-4ea1-a5f5-dffaf3339f0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:19.822321 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c78190-d4ba-4ea1-a5f5-dffaf3339f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-d5c78190-d4ba-4ea1-a5f5-dffaf3339f0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:38:19.832292 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:19.833752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:19.835071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 464/913] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:38:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:19.843231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775357d9-c946-4d74-9ad0-f93b21452660 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:19.929206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:20.041142 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775357d9-c946-4d74-9ad0-f93b21452660 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:20.087501 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:20.088991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:20.088991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:20.088991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:20.089707 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] RBAC: Adding query filter params (name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:20.090121 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:20.091677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:20.101667 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 450/914] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:38:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:20.110315 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78190-d4ba-4ea1-a5f5-dffaf3339f0d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:20.208834 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:20.305953 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78190-d4ba-4ea1-a5f5-dffaf3339f0d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:20.367615 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:20.368791 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:20.369335 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:20.369862 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:20.390131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:20.392817 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:20.421274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:20.423316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:20.425124 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:20.425124 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:20.425124 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:20.433192 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:20.433890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 465/915] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:38:20.614778 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:20.621857 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87724a2-7f96-4fa8-b12f-9999536f1623 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:20.699418 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:20.700474 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:20.700963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:20.701445 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:20.702456 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:20.702932 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:20.705872 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:20.731664 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 451/916] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:20.740505 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:20.909365 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aad86-7625-46c0-ad76-87cb2dca65e1 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:20.911917 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:20.947797 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:20.948483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:20.948784 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:20.949016 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:20.957234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:20.958735 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:38:20.971666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:20.978222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:20.979957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 466/917] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:20.980646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:21.146173 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3de24e-c091-44d3-ae28-01159d285bc0 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:21.203573 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:21.204490 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:21.204968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:21.205457 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:21.206785 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:21.207301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:21.209958 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:21.236001 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 452/918] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 24 08:38:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:21.244019 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:21.399348 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69fde4-2e3b-4806-b345-88ba52b1b20d None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:21.451209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:21.452166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:21.452631 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:21.453120 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:21.468731 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:21.470175 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:21.490580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:21.492374 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:21.494982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:21.494982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:21.494982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:21.494982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 467/919] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:21.500873 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:21.529807 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:21.660333 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6ce72-eb18-4baf-822c-261b588842c4 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:21.706143 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:21.706696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:21.707055 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:21.707442 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:21.708336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:21.708722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:21.710608 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:21.731444 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 453/920] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:21.737033 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:21.764137 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:21.906202 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f736dc2-686d-469b-bd58-03224b40ecac None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:21.962379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:21.963411 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:21.963922 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:21.964355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:21.975459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:21.977190 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:38:21.996751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:21.997965 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:21.999026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:38:21.999026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:38:21.999026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:38:21.999026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:38:21.999026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:38:21.999026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:38:21.999026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:38:21.999026 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:21.999724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 468/921] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:22.009337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:22.145996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:22.178138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ca2ae-66fe-4bb6-a1bc-d56806704bf1 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:22.236923 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b653-6496-4726-894e-ba200b59222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:22.237828 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b653-6496-4726-894e-ba200b59222a None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:22.238256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b653-6496-4726-894e-ba200b59222a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:22.238673 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b653-6496-4726-894e-ba200b59222a None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:22.239514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b653-6496-4726-894e-ba200b59222a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:22.239916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b653-6496-4726-894e-ba200b59222a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:22.241583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b653-6496-4726-894e-ba200b59222a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:22.261209 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 454/922] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:22.269335 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:22.397465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:22.437357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10872396-afb2-4da6-a65b-8bf189c446ca None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:22.485701 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c8f5-c196-4ff9-be1c-1adc8359678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:22.486408 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c8f5-c196-4ff9-be1c-1adc8359678b None admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:22.486683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c8f5-c196-4ff9-be1c-1adc8359678b None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:22.486949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c8f5-c196-4ff9-be1c-1adc8359678b None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/d207dc4d9105430cb337641d736b318f/roles/066edc5a61cb425d8ea5a64af7eb6706` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:22.505241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47c8f5-c196-4ff9-be1c-1adc8359678b None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=d207dc4d9105430cb337641d736b318f, role_id=066edc5a61cb425d8ea5a64af7eb6706)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:22.506761 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47c8f5-c196-4ff9-be1c-1adc8359678b None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:22.522065 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 469/923] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:38:22 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/d207dc4d9105430cb337641d736b318f/roles/066edc5a61cb425d8ea5a64af7eb6706 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:38:25.411357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0d4d-cb5b-4199-8c1f-06697413bede None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:25.412009 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0d4d-cb5b-4199-8c1f-06697413bede None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:25.412009 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0d4d-cb5b-4199-8c1f-06697413bede None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:25.413240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 455/924] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:38:25.423771 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec963-b149-4b5e-a7c9-a7bcf9d8a301 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:25.424344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec963-b149-4b5e-a7c9-a7bcf9d8a301 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:25.424344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec963-b149-4b5e-a7c9-a7bcf9d8a301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:25.446794 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-fe4ec963-b149-4b5e-a7c9-a7bcf9d8a301 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:25.448914 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-fe4ec963-b149-4b5e-a7c9-a7bcf9d8a301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:25.546637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 470/925] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:25.832708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0d4d-cb5b-4199-8c1f-06697413bede None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:25.985318 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0d4d-cb5b-4199-8c1f-06697413bede None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:26.035524 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9dab-5ce4-4622-91fb-9a8aa2f4ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:26.036188 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9dab-5ce4-4622-91fb-9a8aa2f4ea49 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:26.036574 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9dab-5ce4-4622-91fb-9a8aa2f4ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:26.036905 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9dab-5ce4-4622-91fb-9a8aa2f4ea49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:26.046302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:26.051166 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb9dab-5ce4-4622-91fb-9a8aa2f4ea49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-2ffb9dab-5ce4-4622-91fb-9a8aa2f4ea49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:38:26.057185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:26.058543 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:38:26.059504 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:26.060334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 456/926] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Oct 24 08:38:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:26.065838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec963-b149-4b5e-a7c9-a7bcf9d8a301 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:26.160370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:26.254071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec963-b149-4b5e-a7c9-a7bcf9d8a301 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:26.302359 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:26.302982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:26.303260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:26.303528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:26.304203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] RBAC: Adding query filter params (name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:26.304501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:26.305940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:26.316381 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 471/927] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Oct 24 08:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:38:26.324068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9dab-5ce4-4622-91fb-9a8aa2f4ea49 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:26.458874 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9dab-5ce4-4622-91fb-9a8aa2f4ea49 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:26.521038 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:26.522145 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:26.522631 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:26.523110 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:26.542954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:26.544686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:26.567748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:26.569843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:26.570768 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:26.570768 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:26.570768 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:26.570768 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 457/928] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:38:26.583329 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:26.742634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f475a-52c0-465a-a186-efaa08f69c34 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:26.770739 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:26.801022 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:26.801796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:26.801951 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:26.802260 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:26.802977 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:26.803279 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:26.804659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:26.818328 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 472/929] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:26.827307 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:26.909124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:26.994507 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf2a62-0838-400c-8f42-eaf4b54dea8d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:27.049209 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:27.050102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:27.050511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:27.050921 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:27.062405 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:27.064481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:38:27.085278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:27.086676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:27.088918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 458/930] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:38:27.097135 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:27.255774 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6b3b-bda2-47ef-80d1-495b9b6f7401 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:27.316097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:27.317045 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:27.317510 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:27.317982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:27.319161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:27.319561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:27.322517 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:27.348096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 473/931] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 24 08:38:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:27.356330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:27.486359 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f707e25-e3e9-470f-953e-04a8356ccb0d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:27.498912 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:27.528824 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9629a8-09d2-44e4-9721-dbe8d33d1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:27.529463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9629a8-09d2-44e4-9721-dbe8d33d1df2 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:27.529744 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9629a8-09d2-44e4-9721-dbe8d33d1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:27.530015 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9629a8-09d2-44e4-9721-dbe8d33d1df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:27.628500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9629a8-09d2-44e4-9721-dbe8d33d1df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:27.630029 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9629a8-09d2-44e4-9721-dbe8d33d1df2 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:27.785595 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 459/932] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:38:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:38:27.792956 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:27.841184 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:27.965479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c554cab-4146-4165-9321-62ef71e6a28c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:28.014169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:28.015004 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:28.015474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:28.015913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:28.031791 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:28.033838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:28.059638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:28.061618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:28.063499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:28.063499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:28.063499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:28.063499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 474/933] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:28.071115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9629a8-09d2-44e4-9721-dbe8d33d1df2 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:28.089369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:28.271697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9629a8-09d2-44e4-9721-dbe8d33d1df2 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:28.331138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:28.331696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:28.331994 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:28.332335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:28.333039 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:28.333340 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:28.334907 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:28.354991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 460/934] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:28.363118 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:28.497354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:28.516060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e8bbe-9e1a-462b-804d-91d2dcab7908 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:28.556547 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:28.557350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:28.557682 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:28.558035 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:28.568241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:28.570104 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:38:28.587608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:28.590209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:28.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 475/935] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:28.597417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:28.711771 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:28.757783 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6c26-556c-4a05-acbb-46642ff2c407 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:28.810434 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dbf0b-3555-4ad9-9bc1-e5c5268e9f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:28.811668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbf0b-3555-4ad9-9bc1-e5c5268e9f39 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:28.812182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbf0b-3555-4ad9-9bc1-e5c5268e9f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:28.812297 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dbf0b-3555-4ad9-9bc1-e5c5268e9f39 None admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:28.813300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dbf0b-3555-4ad9-9bc1-e5c5268e9f39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:28.813769 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dbf0b-3555-4ad9-9bc1-e5c5268e9f39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:28.815704 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dbf0b-3555-4ad9-9bc1-e5c5268e9f39 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:28.832976 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 461/936] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:38:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:28.843526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:29.006842 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e36b3-697a-4775-8dcb-12a19f4c82e5 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:29.053816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5de98-8eb9-47fa-8cd5-3bb046cf5b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:29.054437 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5de98-8eb9-47fa-8cd5-3bb046cf5b4d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:29.054793 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5de98-8eb9-47fa-8cd5-3bb046cf5b4d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:29.055078 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5de98-8eb9-47fa-8cd5-3bb046cf5b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:29.056068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5de98-8eb9-47fa-8cd5-3bb046cf5b4d None admin] RBAC: Adding query filter params (role.id=066edc5a61cb425d8ea5a64af7eb6706, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=d207dc4d9105430cb337641d736b318f) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:29.056513 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5de98-8eb9-47fa-8cd5-3bb046cf5b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:29.058305 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5de98-8eb9-47fa-8cd5-3bb046cf5b4d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:29.067539 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 476/937] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:38:28 2022] GET /identity/v3/role_assignments?user.id=d207dc4d9105430cb337641d736b318f&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=066edc5a61cb425d8ea5a64af7eb6706 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:38:31.568982 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb425a7-73bd-4166-8696-41b607836ce9 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:31.569882 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb425a7-73bd-4166-8696-41b607836ce9 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:31.569882 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb425a7-73bd-4166-8696-41b607836ce9 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:31.571050 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 462/938] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:38:31.580481 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704740f-1e76-4a3b-b3ab-a769d9bdf380 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:31.581099 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704740f-1e76-4a3b-b3ab-a769d9bdf380 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:31.581830 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704740f-1e76-4a3b-b3ab-a769d9bdf380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:31.621406 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-8704740f-1e76-4a3b-b3ab-a769d9bdf380 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:31.622877 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-8704740f-1e76-4a3b-b3ab-a769d9bdf380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:31.626240 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:31.725413 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 477/939] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:32.094746 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb425a7-73bd-4166-8696-41b607836ce9 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:32.241301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb425a7-73bd-4166-8696-41b607836ce9 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:32.297222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:32.307506 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d243-8e7e-4947-b580-1b832b18d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:32.308375 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d243-8e7e-4947-b580-1b832b18d139 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:32.308764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d243-8e7e-4947-b580-1b832b18d139 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:32.309159 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d243-8e7e-4947-b580-1b832b18d139 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:32.325670 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381d243-8e7e-4947-b580-1b832b18d139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-f381d243-8e7e-4947-b580-1b832b18d139 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:38:32.332086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:32.334162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:32.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 463/940] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:32.347234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704740f-1e76-4a3b-b3ab-a769d9bdf380 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:32.500698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704740f-1e76-4a3b-b3ab-a769d9bdf380 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:32.552647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:32.553710 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:32.554189 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:32.554667 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:32.555887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:32.556955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:32.559443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:32.572810 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 478/941] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:32.580198 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d243-8e7e-4947-b580-1b832b18d139 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:32.741033 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d243-8e7e-4947-b580-1b832b18d139 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:32.789550 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:32.790394 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:32.790925 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:32.791361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:32.803743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:32.805221 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:32.821336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:32.823751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:32.825541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:32.825541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:32.825541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:32.825541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 464/942] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:32.830756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:32.834033 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:32.997281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ff0f-f2cb-4830-80e2-8621cc180a16 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:33.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:33.036759 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:33.037031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:33.037298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:33.037982 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:33.038277 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:33.039689 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:33.055438 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 479/943] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:33.062399 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:33.130525 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:33.212235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88db1c-d9c4-4f66-90f2-198349c26d21 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:33.257676 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:33.258332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:33.258603 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:33.258868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:33.270314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:33.272135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:38:33.288702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:33.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:33.293380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 465/944] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:33.300129 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:33.401602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:33.464974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4b3ac-4208-4282-abb2-abb2d0f84250 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:33.515248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:33.516283 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:33.516798 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:33.517353 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:33.518700 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:33.519244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:33.522013 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:33.553653 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 480/945] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 24 08:38:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:38:33.559743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:33.750124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cd7d3-8edd-4370-a276-d58f9f4bf464 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:33.753216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:33.815313 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:33.816155 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:33.816459 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:33.816748 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:33.830713 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:33.832465 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:33.854720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:33.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:33.857234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:33.857234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:33.857234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:33.857234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 466/946] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:33.863667 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:34.033015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4deff3-6706-4dad-86b1-cf479be89e0c None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:34.070578 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:34.097497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:34.098144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:34.098423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:34.098697 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:34.099366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:34.099670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:34.101089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:34.119892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 481/947] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:38:34.127173 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:34.308638 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81072d-ab0e-4e73-b6da-181ef0bc8313 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:34.360963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:34.362092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:34.362498 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:34.362865 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:34.372957 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:34.375397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:38:34.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:34.396701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:34.398950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 467/948] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:34.406279 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:34.558737 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af78fec-8755-4249-85a1-36b192dfac61 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:34.612457 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366636d-5b48-4cbc-aece-36bbfd4bc346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:34.613060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366636d-5b48-4cbc-aece-36bbfd4bc346 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:34.613431 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366636d-5b48-4cbc-aece-36bbfd4bc346 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:34.613783 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366636d-5b48-4cbc-aece-36bbfd4bc346 None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:34.614821 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366636d-5b48-4cbc-aece-36bbfd4bc346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:34.615181 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366636d-5b48-4cbc-aece-36bbfd4bc346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:34.617097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366636d-5b48-4cbc-aece-36bbfd4bc346 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:34.636075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 482/949] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:34.646037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:34.675378 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:34.852396 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c20e4-70b9-44c3-b0f1-9de638bd6190 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:34.900719 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d73bee-02c5-4497-831f-b617ff05f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:34.901309 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73bee-02c5-4497-831f-b617ff05f331 None admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:34.901682 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73bee-02c5-4497-831f-b617ff05f331 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:34.901899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73bee-02c5-4497-831f-b617ff05f331 None admin] PATH_INFO: `/v3/projects/93d7298c45f049239359485d9ab62bbf/users/d207dc4d9105430cb337641d736b318f/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:34.904296 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d73bee-02c5-4497-831f-b617ff05f331 None admin] RBAC: Authorizing `identity:create_grant(project_id=93d7298c45f049239359485d9ab62bbf, user_id=d207dc4d9105430cb337641d736b318f, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:34.906163 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d73bee-02c5-4497-831f-b617ff05f331 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:34.926329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 468/950] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Oct 24 08:38:34 2022] PUT /identity/v3/projects/93d7298c45f049239359485d9ab62bbf/users/d207dc4d9105430cb337641d736b318f/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:38:37.553387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4484-ee76-401d-999a-fac28d449ab7 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:37.555011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4484-ee76-401d-999a-fac28d449ab7 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:37.555011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4484-ee76-401d-999a-fac28d449ab7 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:37.555562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 483/951] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:38:37.566738 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a266-6e93-411a-ad79-0950e94b4ecb None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:37.567849 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a266-6e93-411a-ad79-0950e94b4ecb None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:37.568035 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a266-6e93-411a-ad79-0950e94b4ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:37.610320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-28e9a266-6e93-411a-ad79-0950e94b4ecb None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:37.612678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-28e9a266-6e93-411a-ad79-0950e94b4ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:37.715718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 469/952] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:38.030243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4484-ee76-401d-999a-fac28d449ab7 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:38.086341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:38.180016 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4484-ee76-401d-999a-fac28d449ab7 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:38.236219 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e5c53-33bd-4d44-bc9b-168c50d0a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:38.237181 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5c53-33bd-4d44-bc9b-168c50d0a325 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:38.237717 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5c53-33bd-4d44-bc9b-168c50d0a325 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:38.238206 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5c53-33bd-4d44-bc9b-168c50d0a325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:38.261344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e5c53-33bd-4d44-bc9b-168c50d0a325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-1c8e5c53-33bd-4d44-bc9b-168c50d0a325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:38:38.267052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:38.268891 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:38.270720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 484/953] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Oct 24 08:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:38.275922 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9a266-6e93-411a-ad79-0950e94b4ecb None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:38.280669 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:38.440766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9a266-6e93-411a-ad79-0950e94b4ecb None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:38.486422 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:38.487137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:38.487610 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:38.488026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:38.488967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:38.489663 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:38.491398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:38.511763 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 470/954] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Oct 24 08:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:38.522180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e5c53-33bd-4d44-bc9b-168c50d0a325 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:38.687171 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:38.691339 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e5c53-33bd-4d44-bc9b-168c50d0a325 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:38.746586 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:38.747585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:38.748362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:38.748971 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:38.775843 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:38.779190 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:38.808355 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:38.809796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:38.811158 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:38.811158 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:38.811158 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:38.811158 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 485/955] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:38.817797 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:38.901983 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:38.946224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6d60e-873d-4c25-a135-f75efa6aea49 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:38.998836 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:38.999413 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:38.999691 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:38.999991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:39.000744 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:39.001072 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:39.002810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:39.021581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 471/956] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:39.027539 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:39.179615 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1f5d-29f1-4c0a-855b-b789faccaca8 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:39.223659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:39.224618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:39.225072 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:39.225572 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:39.238474 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:39.240369 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:38:39.256898 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:39.258929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:39.260865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 486/957] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:38:39.266259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:39.412958 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5aed7-e4d6-4666-927a-2dc1b3c231c0 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:39.445864 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:39.457530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:39.458157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:39.458448 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:39.458726 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:39.459583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:39.459896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:39.461557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:39.493355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 472/958] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Oct 24 08:38:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:39.501783 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:39.520723 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:39.644950 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3f30-20b6-4066-9bae-d603a5da0fb9 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:39.701678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ad85f-ac68-4b97-a153-5d20bc549ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:39.702682 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad85f-ac68-4b97-a153-5d20bc549ff4 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:39.703031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad85f-ac68-4b97-a153-5d20bc549ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:39.703467 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad85f-ac68-4b97-a153-5d20bc549ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:39.812633 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ad85f-ac68-4b97-a153-5d20bc549ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:39.814398 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ad85f-ac68-4b97-a153-5d20bc549ff4 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:39.832023 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:39.975363 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 487/959] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Oct 24 08:38:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 08:38:39.981222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:40.133500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8104c26-8d97-412e-998e-54b70fa6ee5d None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:40.197649 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:40.198394 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:40.198734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:40.199086 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:40.218072 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:40.221119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:38:40.241040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:40.242276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:38:40.243353 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:38:40.243353 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:38:40.243353 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:40.243353 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 473/960] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:38:40.251303 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ad85f-ac68-4b97-a153-5d20bc549ff4 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:40.430641 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ad85f-ac68-4b97-a153-5d20bc549ff4 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:40.456726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:40.483075 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:40.483700 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:40.483981 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:40.484242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:40.484918 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:40.485218 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:40.486694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:40.514752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 488/961] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Oct 24 08:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:40.516041 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:40.578908 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:40.668458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f4d5-be91-487a-834b-5dc67e226825 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:40.716753 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:40.717325 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:40.717633 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:40.717903 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:40.726363 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:40.727953 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:38:40.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:40.744954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: ERROR keystone.server.flask.application Oct 24 08:38:40.745951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 474/962] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Oct 24 08:38:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:40.751909 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:40.907772 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f54b32-2488-4c92-8719-0a7851771397 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:40.954585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799dc9b-f5aa-40ee-81dc-1620388487df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:40.955716 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799dc9b-f5aa-40ee-81dc-1620388487df None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:40.956197 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799dc9b-f5aa-40ee-81dc-1620388487df None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:40.956662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799dc9b-f5aa-40ee-81dc-1620388487df None admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:40.957973 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799dc9b-f5aa-40ee-81dc-1620388487df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:40.958525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799dc9b-f5aa-40ee-81dc-1620388487df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:40.960462 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799dc9b-f5aa-40ee-81dc-1620388487df None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:40.975424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 489/963] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Oct 24 08:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:38:40.982236 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:41.106895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:41.113764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efd20a-39ed-46f8-8618-6774cf1bea57 None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:41.152514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511eaf3d-439d-4e94-b991-3d1c79ff4d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:41.153125 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eaf3d-439d-4e94-b991-3d1c79ff4d6d None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:41.153401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eaf3d-439d-4e94-b991-3d1c79ff4d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:41.153706 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eaf3d-439d-4e94-b991-3d1c79ff4d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:41.154447 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eaf3d-439d-4e94-b991-3d1c79ff4d6d None admin] RBAC: Adding query filter params (role.id=ebf9799815574909aa1c88e93e213c96, scope.project.id=93d7298c45f049239359485d9ab62bbf, user.id=d207dc4d9105430cb337641d736b318f) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:41.154749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eaf3d-439d-4e94-b991-3d1c79ff4d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:41.156185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eaf3d-439d-4e94-b991-3d1c79ff4d6d None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:41.162926 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 475/964] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Oct 24 08:38:40 2022] GET /identity/v3/role_assignments?user.id=d207dc4d9105430cb337641d736b318f&scope.project.id=93d7298c45f049239359485d9ab62bbf&role.id=ebf9799815574909aa1c88e93e213c96 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:43.419619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ffd62-80ad-46a8-b40d-cd6c7b6eb0fd None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:43.420209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ffd62-80ad-46a8-b40d-cd6c7b6eb0fd None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:43.420209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ffd62-80ad-46a8-b40d-cd6c7b6eb0fd None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:43.421497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 490/965] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:38:43.427158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27589b8b-9e70-4ed7-b26c-90ba8f6e5a41 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:43.427720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27589b8b-9e70-4ed7-b26c-90ba8f6e5a41 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:43.427720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27589b8b-9e70-4ed7-b26c-90ba8f6e5a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:43.447776 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-27589b8b-9e70-4ed7-b26c-90ba8f6e5a41 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:43.449017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-27589b8b-9e70-4ed7-b26c-90ba8f6e5a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:43.525071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 476/966] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:43.805841 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ffd62-80ad-46a8-b40d-cd6c7b6eb0fd None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:43.840890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:43.943796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ffd62-80ad-46a8-b40d-cd6c7b6eb0fd None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:43.981106 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:43.981578 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:43.981855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:43.982125 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:43.982711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:43.984073 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:43.993963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:43.996215 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:43.998203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 491/967] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 24 08:38:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:44.005071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27589b8b-9e70-4ed7-b26c-90ba8f6e5a41 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:44.105391 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:44.116137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27589b8b-9e70-4ed7-b26c-90ba8f6e5a41 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:44.153762 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36ddef-a491-4a40-8ff1-22009fab4fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:44.154392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ddef-a491-4a40-8ff1-22009fab4fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:44.154672 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ddef-a491-4a40-8ff1-22009fab4fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:44.154944 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ddef-a491-4a40-8ff1-22009fab4fb9 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:44.155590 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ddef-a491-4a40-8ff1-22009fab4fb9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:44.155895 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ddef-a491-4a40-8ff1-22009fab4fb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:44.157274 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ddef-a491-4a40-8ff1-22009fab4fb9 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:44.162981 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 477/968] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 24 08:38:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:44.172837 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:44.291118 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:44.298831 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de82bc-d741-4e9c-aaf0-0406f6794a2f None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:44.335636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d60108-a5a9-4b7d-a6f8-d5a3e1a0db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:44.336244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60108-a5a9-4b7d-a6f8-d5a3e1a0db90 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:44.336521 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60108-a5a9-4b7d-a6f8-d5a3e1a0db90 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:44.336795 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60108-a5a9-4b7d-a6f8-d5a3e1a0db90 None admin] PATH_INFO: `/v3/services` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:44.337637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d60108-a5a9-4b7d-a6f8-d5a3e1a0db90 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:44.337944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d60108-a5a9-4b7d-a6f8-d5a3e1a0db90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:44.339333 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d60108-a5a9-4b7d-a6f8-d5a3e1a0db90 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:44.344382 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 492/969] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 24 08:38:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:46.607283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651c152-d214-4050-9a10-6debd9904fa1 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:46.607891 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651c152-d214-4050-9a10-6debd9904fa1 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:46.608304 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651c152-d214-4050-9a10-6debd9904fa1 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:46.610383 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 478/970] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:38:46.617161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb419-3964-4fc6-b6b5-a3554e18efdf None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:46.617993 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb419-3964-4fc6-b6b5-a3554e18efdf None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:46.618148 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecb419-3964-4fc6-b6b5-a3554e18efdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:46.638946 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-05ecb419-3964-4fc6-b6b5-a3554e18efdf None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:46.640207 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-05ecb419-3964-4fc6-b6b5-a3554e18efdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:46.710756 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 493/971] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:46.981162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651c152-d214-4050-9a10-6debd9904fa1 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:47.094401 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651c152-d214-4050-9a10-6debd9904fa1 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:47.131863 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7c52d-057f-4f4b-b36f-1a5fd12d76e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:47.132478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7c52d-057f-4f4b-b36f-1a5fd12d76e8 None admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:47.132755 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7c52d-057f-4f4b-b36f-1a5fd12d76e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:47.133025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7c52d-057f-4f4b-b36f-1a5fd12d76e8 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:47.133730 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7c52d-057f-4f4b-b36f-1a5fd12d76e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:47.135820 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7c52d-057f-4f4b-b36f-1a5fd12d76e8 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:47.151702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 479/972] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Oct 24 08:38:46 2022] POST /identity/v3/services => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:38:49.561962 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347ef2-b7c3-4ecf-8824-e67c6ef05407 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:49.562573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347ef2-b7c3-4ecf-8824-e67c6ef05407 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:49.562573 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347ef2-b7c3-4ecf-8824-e67c6ef05407 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:49.564085 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 494/973] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:38:49.574152 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a92a9-529a-41f2-b1d7-500fa9a48fa1 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:49.575094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a92a9-529a-41f2-b1d7-500fa9a48fa1 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:49.575094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a92a9-529a-41f2-b1d7-500fa9a48fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:49.598320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-e27a92a9-529a-41f2-b1d7-500fa9a48fa1 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:49.600140 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-e27a92a9-529a-41f2-b1d7-500fa9a48fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:49.616668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:49.697505 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 480/974] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:38:49.976153 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38347ef2-b7c3-4ecf-8824-e67c6ef05407 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:50.079632 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:50.092004 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38347ef2-b7c3-4ecf-8824-e67c6ef05407 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:50.129512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:50.130189 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:50.130519 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:50.130850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:50.131473 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:50.132873 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:50.143326 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:50.145068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:50.146147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 495/975] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 24 08:38:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:50.154025 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a92a9-529a-41f2-b1d7-500fa9a48fa1 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:50.265034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a92a9-529a-41f2-b1d7-500fa9a48fa1 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:50.304200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:50.304899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:50.305214 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:50.305569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:50.307022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:50.307379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:50.308870 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:50.315158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 481/976] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 24 08:38:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:50.322902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:50.473204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d9fec-48d6-4309-9b14-8f0aa3a62016 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:50.510931 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abceef-f57e-4fff-9d3f-68aac16c822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:50.511543 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abceef-f57e-4fff-9d3f-68aac16c822d None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:50.511822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abceef-f57e-4fff-9d3f-68aac16c822d None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:50.512092 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abceef-f57e-4fff-9d3f-68aac16c822d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:50.512792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abceef-f57e-4fff-9d3f-68aac16c822d None admin] RBAC: Adding query filter params (interface=public, service_id=b1607e828b8a4820b00d076beb2cf35c, region_id=RegionOne) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:50.513095 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abceef-f57e-4fff-9d3f-68aac16c822d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:50.514501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abceef-f57e-4fff-9d3f-68aac16c822d None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:50.521149 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 496/977] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Oct 24 08:38:50 2022] GET /identity/v3/endpoints?service_id=b1607e828b8a4820b00d076beb2cf35c&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:50.529310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:50.533398 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:50.638798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a132f-0b51-4d8a-b88b-7c1f0d4de63a None admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:50.675108 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55fdc2-ab6a-4412-81a5-b943792a1b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:50.675833 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fdc2-ab6a-4412-81a5-b943792a1b87 None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:50.676157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fdc2-ab6a-4412-81a5-b943792a1b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:50.676480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55fdc2-ab6a-4412-81a5-b943792a1b87 None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:50.677138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55fdc2-ab6a-4412-81a5-b943792a1b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:50.678623 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55fdc2-ab6a-4412-81a5-b943792a1b87 None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:50.686606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 482/978] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Oct 24 08:38:50 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:38:52.939008 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a546-6068-4207-b1c5-ac4146293aa9 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:52.939579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a546-6068-4207-b1c5-ac4146293aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:52.939686 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a546-6068-4207-b1c5-ac4146293aa9 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:52.941110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 497/979] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:38:52.947149 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bcc3-a847-4778-9321-3c62067f93bd None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:52.947770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bcc3-a847-4778-9321-3c62067f93bd None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:52.947770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bcc3-a847-4778-9321-3c62067f93bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:52.970223 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-9030bcc3-a847-4778-9321-3c62067f93bd None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:52.971512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-9030bcc3-a847-4778-9321-3c62067f93bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:53.044897 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:53.051585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 483/980] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:38:53.331268 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a546-6068-4207-b1c5-ac4146293aa9 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:53.352056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:53.442864 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a546-6068-4207-b1c5-ac4146293aa9 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:53.480094 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:53.480728 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:53.481007 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:53.481278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:53.481895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:53.483251 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:53.492243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:53.494385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: ERROR keystone.server.flask.application Oct 24 08:38:53.496034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 498/981] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Oct 24 08:38:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:38:53.499970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bcc3-a847-4778-9321-3c62067f93bd None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:53.623847 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bcc3-a847-4778-9321-3c62067f93bd None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:53.667357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f93b51-c6d5-4e1d-8e9b-665b8264668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:53.667997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f93b51-c6d5-4e1d-8e9b-665b8264668c None admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:53.668275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f93b51-c6d5-4e1d-8e9b-665b8264668c None admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:53.668545 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f93b51-c6d5-4e1d-8e9b-665b8264668c None admin] PATH_INFO: `/v3/services` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:53.669189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f93b51-c6d5-4e1d-8e9b-665b8264668c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:53.669518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f93b51-c6d5-4e1d-8e9b-665b8264668c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:53.670900 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f93b51-c6d5-4e1d-8e9b-665b8264668c None admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:53.679524 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 484/982] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Oct 24 08:38:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:38:53.686720 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:53.825905 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:53.857418 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d6c72-d156-46d8-91c2-e5318c8bb835 None admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:53.916224 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497331c3-687f-4a0b-860a-2e9f45fb22e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:53.917159 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497331c3-687f-4a0b-860a-2e9f45fb22e0 None admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:53.917689 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497331c3-687f-4a0b-860a-2e9f45fb22e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:53.918180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497331c3-687f-4a0b-860a-2e9f45fb22e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:53.919387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497331c3-687f-4a0b-860a-2e9f45fb22e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:53.922035 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497331c3-687f-4a0b-860a-2e9f45fb22e0 None admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:53.950937 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 499/983] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:38:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:39:03.673279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=69 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:03.946453 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:01.999064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e0c8-f065-4e4b-96a0-26ddd4fd2c3a None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:01.999627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e0c8-f065-4e4b-96a0-26ddd4fd2c3a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:01.999974 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e0c8-f065-4e4b-96a0-26ddd4fd2c3a None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:02.008779 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 485/984] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:02.010298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea65d-5d65-4561-9f69-f569eb715820 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:02.010771 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea65d-5d65-4561-9f69-f569eb715820 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:02.010968 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea65d-5d65-4561-9f69-f569eb715820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:02.161348 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-ae1ea65d-5d65-4561-9f69-f569eb715820 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:02.162692 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-ae1ea65d-5d65-4561-9f69-f569eb715820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:02.321078 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 500/985] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:02.621334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d10b9-4be5-463d-91cf-bd53b9bba6df None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:02.621797 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d10b9-4be5-463d-91cf-bd53b9bba6df None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:02.622160 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d10b9-4be5-463d-91cf-bd53b9bba6df None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:02.623792 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 486/986] 10.222.0.23 () {54 vars in 964 bytes} [Mon Oct 24 08:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:40:02.630587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939519dc-6dc5-4f3f-b520-b4b5fc98adb1 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:02.630957 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939519dc-6dc5-4f3f-b520-b4b5fc98adb1 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:02.631460 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939519dc-6dc5-4f3f-b520-b4b5fc98adb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:02.755056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-939519dc-6dc5-4f3f-b520-b4b5fc98adb1 None None] MFA Rules not processed for user `2facaae2a22448bcb52811b9cee5f0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:02.756844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-939519dc-6dc5-4f3f-b520-b4b5fc98adb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:02.789606 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:02.865299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 501/987] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Oct 24 08:40:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:02.874658 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d10b9-4be5-463d-91cf-bd53b9bba6df None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:02.876416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-2b7d10b9-4be5-463d-91cf-bd53b9bba6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:03.034621 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d10b9-4be5-463d-91cf-bd53b9bba6df None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:03.138190 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469bff6-e916-405a-bb19-75a15a62a7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:03.138916 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469bff6-e916-405a-bb19-75a15a62a7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:03.139493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469bff6-e916-405a-bb19-75a15a62a7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:03.139709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469bff6-e916-405a-bb19-75a15a62a7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:03.142080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a469bff6-e916-405a-bb19-75a15a62a7f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:03.231139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:03.318310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469bff6-e916-405a-bb19-75a15a62a7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:03.320849 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469bff6-e916-405a-bb19-75a15a62a7f8 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:03.346860 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 487/988] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:40:05.972319 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2094f5a-1610-4a6d-9d58-7de486abab7d None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:05.972870 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2094f5a-1610-4a6d-9d58-7de486abab7d None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:05.972954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2094f5a-1610-4a6d-9d58-7de486abab7d None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:05.974630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 502/989] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:05.980749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df821-6cfe-46d8-a9d4-023841c75ebd None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:05.981100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df821-6cfe-46d8-a9d4-023841c75ebd None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:05.981245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df821-6cfe-46d8-a9d4-023841c75ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:06.058337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-226df821-6cfe-46d8-a9d4-023841c75ebd None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:06.059591 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-226df821-6cfe-46d8-a9d4-023841c75ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:06.156932 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 488/990] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:40:06.466687 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69fc04-8776-476e-ad90-f0dafd0d2bda None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:06.466967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69fc04-8776-476e-ad90-f0dafd0d2bda None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:06.467239 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69fc04-8776-476e-ad90-f0dafd0d2bda None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:06.468580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 503/991] 10.222.0.23 () {54 vars in 964 bytes} [Mon Oct 24 08:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:06.474480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcda1e-c9fc-4c94-b550-00150bc04507 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:06.474762 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcda1e-c9fc-4c94-b550-00150bc04507 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:06.475032 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcda1e-c9fc-4c94-b550-00150bc04507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:06.486958 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:06.557222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-08bcda1e-c9fc-4c94-b550-00150bc04507 None None] MFA Rules not processed for user `2facaae2a22448bcb52811b9cee5f0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:06.558505 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-08bcda1e-c9fc-4c94-b550-00150bc04507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:06.633745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 489/992] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Oct 24 08:40:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:06.642696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69fc04-8776-476e-ad90-f0dafd0d2bda None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:06.644219 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-5d69fc04-8776-476e-ad90-f0dafd0d2bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:06.750418 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69fc04-8776-476e-ad90-f0dafd0d2bda None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:06.822719 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:06.825385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2e91e-3f4c-478e-b7c4-2a9cd448c658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:06.826186 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2e91e-3f4c-478e-b7c4-2a9cd448c658 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:06.826640 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2e91e-3f4c-478e-b7c4-2a9cd448c658 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:06.827089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2e91e-3f4c-478e-b7c4-2a9cd448c658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:06.828700 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e6a2e91e-3f4c-478e-b7c4-2a9cd448c658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:06.937688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2e91e-3f4c-478e-b7c4-2a9cd448c658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:06.939174 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2e91e-3f4c-478e-b7c4-2a9cd448c658 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:06.959069 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 504/993] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:09.721719 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6640-95e5-40fd-9c9a-417752216954 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:09.722255 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6640-95e5-40fd-9c9a-417752216954 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:09.722255 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d6640-95e5-40fd-9c9a-417752216954 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:09.723616 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 490/994] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:09.729776 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef1f7-4fa1-4df6-91e1-04f2a6af07e9 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:09.730232 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef1f7-4fa1-4df6-91e1-04f2a6af07e9 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:09.730328 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfef1f7-4fa1-4df6-91e1-04f2a6af07e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:09.795987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-abfef1f7-4fa1-4df6-91e1-04f2a6af07e9 None None] MFA Rules not processed for user `7489ba24403840d28228fe5a47b9b63d`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:09.797186 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-abfef1f7-4fa1-4df6-91e1-04f2a6af07e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:09.849160 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:09.893848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 505/995] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:10.180403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d6640-95e5-40fd-9c9a-417752216954 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:10.181996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-947d6640-95e5-40fd-9c9a-417752216954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:10.294397 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d6640-95e5-40fd-9c9a-417752216954 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:10.297152 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:10.369701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252836d8-3ffb-4118-95c5-6896900dcec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:10.370306 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252836d8-3ffb-4118-95c5-6896900dcec8 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:10.370585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252836d8-3ffb-4118-95c5-6896900dcec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:10.370854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252836d8-3ffb-4118-95c5-6896900dcec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:10.372444 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-252836d8-3ffb-4118-95c5-6896900dcec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:10.479883 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252836d8-3ffb-4118-95c5-6896900dcec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:10.481312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252836d8-3ffb-4118-95c5-6896900dcec8 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:10.500100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 491/996] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:13.264274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032e19-73ef-42d6-991d-655422bbf743 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:13.264817 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032e19-73ef-42d6-991d-655422bbf743 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:13.264817 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9032e19-73ef-42d6-991d-655422bbf743 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:13.266165 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 506/997] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:13.271377 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae676c9-17ea-4327-9255-58e0cc863e9a None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:13.271817 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae676c9-17ea-4327-9255-58e0cc863e9a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:13.271936 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae676c9-17ea-4327-9255-58e0cc863e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:13.312932 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:13.339834 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-9ae676c9-17ea-4327-9255-58e0cc863e9a None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:13.341040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-9ae676c9-17ea-4327-9255-58e0cc863e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:13.440664 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 492/998] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:13.730948 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032e19-73ef-42d6-991d-655422bbf743 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:13.732465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e9032e19-73ef-42d6-991d-655422bbf743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:13.832603 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9032e19-73ef-42d6-991d-655422bbf743 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:13.905785 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba3d53-2be2-4226-a329-b95937a3e0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:13.906384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3d53-2be2-4226-a329-b95937a3e0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:13.906661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3d53-2be2-4226-a329-b95937a3e0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:13.906931 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3d53-2be2-4226-a329-b95937a3e0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:13.908530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-96ba3d53-2be2-4226-a329-b95937a3e0e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:13.916076 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:14.021867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3d53-2be2-4226-a329-b95937a3e0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:14.023940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3d53-2be2-4226-a329-b95937a3e0e1 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:14.042480 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 507/999] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:16.951376 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83af90-a18e-458a-87bc-58de08488ebb None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:16.951959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83af90-a18e-458a-87bc-58de08488ebb None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:16.951959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83af90-a18e-458a-87bc-58de08488ebb None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:16.953314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 493/1000] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:16.959344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3ba2-0b65-4b58-b489-cc4812c2ede5 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:16.959914 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3ba2-0b65-4b58-b489-cc4812c2ede5 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:16.960361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3ba2-0b65-4b58-b489-cc4812c2ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:17.041060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-dd1e3ba2-0b65-4b58-b489-cc4812c2ede5 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:17.042334 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-dd1e3ba2-0b65-4b58-b489-cc4812c2ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:17.107376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:17.152549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 508/1001] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:17.443885 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83af90-a18e-458a-87bc-58de08488ebb None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:17.446255 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-5d83af90-a18e-458a-87bc-58de08488ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:17.557357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83af90-a18e-458a-87bc-58de08488ebb None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:17.573463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:17.652092 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99843c4-2b53-4ea0-8ed9-758fae325232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:17.652795 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99843c4-2b53-4ea0-8ed9-758fae325232 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:17.653135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99843c4-2b53-4ea0-8ed9-758fae325232 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:17.653477 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99843c4-2b53-4ea0-8ed9-758fae325232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:17.655381 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a99843c4-2b53-4ea0-8ed9-758fae325232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:17.780792 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99843c4-2b53-4ea0-8ed9-758fae325232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:17.782275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99843c4-2b53-4ea0-8ed9-758fae325232 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:17.802435 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 494/1002] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:20.087443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501c31-40ab-4b52-9aab-8de45683de68 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:20.087966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501c31-40ab-4b52-9aab-8de45683de68 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:20.088058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501c31-40ab-4b52-9aab-8de45683de68 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:20.089525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 509/1003] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:20.094827 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b287a4-14d3-4d3c-a8e1-bbd899be3cbc None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:20.095275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b287a4-14d3-4d3c-a8e1-bbd899be3cbc None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:20.095351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b287a4-14d3-4d3c-a8e1-bbd899be3cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:20.154336 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:20.173965 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-b3b287a4-14d3-4d3c-a8e1-bbd899be3cbc None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:20.175159 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-b3b287a4-14d3-4d3c-a8e1-bbd899be3cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:20.277000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 495/1004] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:20.563195 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c501c31-40ab-4b52-9aab-8de45683de68 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:20.564747 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-0c501c31-40ab-4b52-9aab-8de45683de68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:20.672054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c501c31-40ab-4b52-9aab-8de45683de68 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:20.749244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085319e-47f6-41ac-bf31-e60c93e19440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:20.750189 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085319e-47f6-41ac-bf31-e60c93e19440 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:20.750464 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085319e-47f6-41ac-bf31-e60c93e19440 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:20.750731 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085319e-47f6-41ac-bf31-e60c93e19440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:20.752316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-5085319e-47f6-41ac-bf31-e60c93e19440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:20.771109 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:20.865652 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085319e-47f6-41ac-bf31-e60c93e19440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:20.867569 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085319e-47f6-41ac-bf31-e60c93e19440 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:20.886604 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 510/1005] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:23.169684 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687b928-5e44-44bb-90be-2957024effed None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:23.170293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687b928-5e44-44bb-90be-2957024effed None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:23.170293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687b928-5e44-44bb-90be-2957024effed None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:23.171751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 496/1006] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:23.177383 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6bbac-bc08-483e-a50c-7acbe630d168 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:23.177933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6bbac-bc08-483e-a50c-7acbe630d168 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:23.178114 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6bbac-bc08-483e-a50c-7acbe630d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:23.250139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-a6b6bbac-bc08-483e-a50c-7acbe630d168 None None] MFA Rules not processed for user `7489ba24403840d28228fe5a47b9b63d`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:23.251459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-a6b6bbac-bc08-483e-a50c-7acbe630d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:23.323417 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:23.358277 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 511/1007] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:23.646636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687b928-5e44-44bb-90be-2957024effed None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:23.648910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-1687b928-5e44-44bb-90be-2957024effed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:23.761521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687b928-5e44-44bb-90be-2957024effed None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:23.782702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:23.841037 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f612d0-f8e2-4f37-aa5d-186a564f8e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:23.841877 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f612d0-f8e2-4f37-aa5d-186a564f8e65 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:23.842151 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f612d0-f8e2-4f37-aa5d-186a564f8e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:23.842443 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f612d0-f8e2-4f37-aa5d-186a564f8e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:23.844001 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a7f612d0-f8e2-4f37-aa5d-186a564f8e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:23.954766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f612d0-f8e2-4f37-aa5d-186a564f8e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:23.956132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f612d0-f8e2-4f37-aa5d-186a564f8e65 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:23.977012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 497/1008] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:26.419845 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765afd-ffde-4946-a1ab-55933e088660 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:26.420430 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765afd-ffde-4946-a1ab-55933e088660 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:26.420430 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765afd-ffde-4946-a1ab-55933e088660 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:26.421760 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 512/1009] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:26.427093 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686997bd-c13a-4ef8-a5ae-c7f692abbbf6 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:26.427498 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686997bd-c13a-4ef8-a5ae-c7f692abbbf6 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:26.427640 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686997bd-c13a-4ef8-a5ae-c7f692abbbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:26.492380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:26.495606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-686997bd-c13a-4ef8-a5ae-c7f692abbbf6 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:26.497360 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-686997bd-c13a-4ef8-a5ae-c7f692abbbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:26.593984 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 498/1010] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:26.879938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82765afd-ffde-4946-a1ab-55933e088660 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:26.882553 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-82765afd-ffde-4946-a1ab-55933e088660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:26.987684 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82765afd-ffde-4946-a1ab-55933e088660 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:27.061935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a315482-1c8b-4635-80a0-d6f099949077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:27.062550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315482-1c8b-4635-80a0-d6f099949077 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:27.062824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315482-1c8b-4635-80a0-d6f099949077 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:27.063091 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315482-1c8b-4635-80a0-d6f099949077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:27.064687 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-3a315482-1c8b-4635-80a0-d6f099949077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:27.093006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:27.175234 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a315482-1c8b-4635-80a0-d6f099949077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:27.176616 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a315482-1c8b-4635-80a0-d6f099949077 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:27.195819 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 513/1011] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:29.458903 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664b36-3928-4696-9e80-29f013cdf5c4 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:29.460077 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664b36-3928-4696-9e80-29f013cdf5c4 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:29.460583 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664b36-3928-4696-9e80-29f013cdf5c4 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:29.461990 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 499/1012] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:29.467402 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4b8a-2f3b-4d16-9d5d-8115a65469ac None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:29.467862 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4b8a-2f3b-4d16-9d5d-8115a65469ac None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:29.467963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4b8a-2f3b-4d16-9d5d-8115a65469ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:29.539231 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-71de4b8a-2f3b-4d16-9d5d-8115a65469ac None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:29.540451 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-71de4b8a-2f3b-4d16-9d5d-8115a65469ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:29.618563 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:29.642255 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 514/1013] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:29.936170 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73664b36-3928-4696-9e80-29f013cdf5c4 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:29.937780 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-73664b36-3928-4696-9e80-29f013cdf5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:30.046222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73664b36-3928-4696-9e80-29f013cdf5c4 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:30.075506 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:30.124560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4e8f8-27e3-4d9e-8f61-20281077be62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:30.125690 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e8f8-27e3-4d9e-8f61-20281077be62 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:30.125690 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e8f8-27e3-4d9e-8f61-20281077be62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:30.126777 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e8f8-27e3-4d9e-8f61-20281077be62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:30.127811 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-07f4e8f8-27e3-4d9e-8f61-20281077be62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:30.239514 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4e8f8-27e3-4d9e-8f61-20281077be62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:30.241144 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4e8f8-27e3-4d9e-8f61-20281077be62 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:30.259511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 500/1014] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:32.835351 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb55d-a949-492a-b512-2487fd845d4c None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:32.835879 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb55d-a949-492a-b512-2487fd845d4c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:32.835879 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bb55d-a949-492a-b512-2487fd845d4c None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:32.837256 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 515/1015] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:32.842653 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42c7a-1eac-400b-9bf0-e6a2d2cc84ac None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:32.843110 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42c7a-1eac-400b-9bf0-e6a2d2cc84ac None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:32.843211 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42c7a-1eac-400b-9bf0-e6a2d2cc84ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:32.909633 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-ebc42c7a-1eac-400b-9bf0-e6a2d2cc84ac None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:32.910818 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ebc42c7a-1eac-400b-9bf0-e6a2d2cc84ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:32.919930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:33.013943 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 501/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:33.305122 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bb55d-a949-492a-b512-2487fd845d4c None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:33.306685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-233bb55d-a949-492a-b512-2487fd845d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:33.410966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bb55d-a949-492a-b512-2487fd845d4c None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:33.487072 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d929-a6cc-4e17-8865-1bc6fddd9554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:33.487586 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d929-a6cc-4e17-8865-1bc6fddd9554 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:33.487862 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d929-a6cc-4e17-8865-1bc6fddd9554 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:33.488131 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d929-a6cc-4e17-8865-1bc6fddd9554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:33.489777 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-15e2d929-a6cc-4e17-8865-1bc6fddd9554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:33.526607 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:33.603046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2d929-a6cc-4e17-8865-1bc6fddd9554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:33.604468 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2d929-a6cc-4e17-8865-1bc6fddd9554 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:33.623042 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 516/1017] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:40:37.854337 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271fc8-a054-4d66-923b-dc33a988144b None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:37.854831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271fc8-a054-4d66-923b-dc33a988144b None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:37.854831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd271fc8-a054-4d66-923b-dc33a988144b None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:37.856241 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 502/1018] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:37.861730 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a7fda-a4bc-477a-a357-02366322f21f None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:37.862165 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a7fda-a4bc-477a-a357-02366322f21f None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:37.862256 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a7fda-a4bc-477a-a357-02366322f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:37.931635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-2e9a7fda-a4bc-477a-a357-02366322f21f None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:37.932759 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-2e9a7fda-a4bc-477a-a357-02366322f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:38.023229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:38.034683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 517/1019] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:38.319513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd271fc8-a054-4d66-923b-dc33a988144b None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:38.321124 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-dd271fc8-a054-4d66-923b-dc33a988144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:38.436437 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd271fc8-a054-4d66-923b-dc33a988144b None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:38.477062 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:38.515102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f52a1-d779-4e51-ac17-a47b40e8915a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:38.515712 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f52a1-d779-4e51-ac17-a47b40e8915a service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:38.515991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f52a1-d779-4e51-ac17-a47b40e8915a service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:38.516261 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f52a1-d779-4e51-ac17-a47b40e8915a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:38.517884 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-960f52a1-d779-4e51-ac17-a47b40e8915a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:38.630850 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f52a1-d779-4e51-ac17-a47b40e8915a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:38.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f52a1-d779-4e51-ac17-a47b40e8915a service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:38.650689 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 503/1020] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:41.632566 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12cca4-a810-4e47-b83e-97c38b7b3433 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:41.633103 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12cca4-a810-4e47-b83e-97c38b7b3433 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:41.633103 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12cca4-a810-4e47-b83e-97c38b7b3433 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:41.634685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 518/1021] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:41.639788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f42e4-16eb-4652-9285-68e11cf92d37 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:41.640194 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f42e4-16eb-4652-9285-68e11cf92d37 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:41.640392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f42e4-16eb-4652-9285-68e11cf92d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:41.713979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-669f42e4-16eb-4652-9285-68e11cf92d37 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:41.715536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-669f42e4-16eb-4652-9285-68e11cf92d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:41.734240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:41.814166 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 504/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:42.113960 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12cca4-a810-4e47-b83e-97c38b7b3433 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:42.116080 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-fa12cca4-a810-4e47-b83e-97c38b7b3433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:42.229817 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12cca4-a810-4e47-b83e-97c38b7b3433 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:42.325562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ed7f0-affd-4084-a1b4-a50ded7155c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:42.325562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed7f0-affd-4084-a1b4-a50ded7155c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:42.325562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed7f0-affd-4084-a1b4-a50ded7155c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:42.325562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed7f0-affd-4084-a1b4-a50ded7155c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:42.328546 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-c26ed7f0-affd-4084-a1b4-a50ded7155c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:42.386263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:42.490300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ed7f0-affd-4084-a1b4-a50ded7155c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:42.491647 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ed7f0-affd-4084-a1b4-a50ded7155c7 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:42.512832 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 519/1023] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:47.467661 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096967ac-d935-47b8-a907-20ce8bba6f78 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:47.468481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096967ac-d935-47b8-a907-20ce8bba6f78 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:47.468481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096967ac-d935-47b8-a907-20ce8bba6f78 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:47.469747 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 505/1024] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:47.476259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6735f29-2fc3-4294-b4a6-2833c4cf3775 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:47.477145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6735f29-2fc3-4294-b4a6-2833c4cf3775 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:47.477145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6735f29-2fc3-4294-b4a6-2833c4cf3775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:47.577847 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-b6735f29-2fc3-4294-b4a6-2833c4cf3775 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:47.579458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-b6735f29-2fc3-4294-b4a6-2833c4cf3775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:47.710609 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:47.721886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 520/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:48.048524 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096967ac-d935-47b8-a907-20ce8bba6f78 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:48.050342 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-096967ac-d935-47b8-a907-20ce8bba6f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:48.203843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096967ac-d935-47b8-a907-20ce8bba6f78 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:48.268114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:48.301344 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b86449-f1e0-4c6c-8fc8-35969620d9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:48.301967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b86449-f1e0-4c6c-8fc8-35969620d9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:48.302817 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b86449-f1e0-4c6c-8fc8-35969620d9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:48.303162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b86449-f1e0-4c6c-8fc8-35969620d9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:48.305158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-27b86449-f1e0-4c6c-8fc8-35969620d9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:48.435848 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b86449-f1e0-4c6c-8fc8-35969620d9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:48.437505 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b86449-f1e0-4c6c-8fc8-35969620d9d9 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:48.460947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 506/1026] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:54.326143 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db257-bbf1-4a03-8a57-79ddf83ab978 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:54.327094 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db257-bbf1-4a03-8a57-79ddf83ab978 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:54.327530 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db257-bbf1-4a03-8a57-79ddf83ab978 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:54.331679 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 521/1027] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 24 08:40:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:54.341066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f089c-e2cc-4e59-ba92-a0ea73f7ff6d None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:54.341698 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f089c-e2cc-4e59-ba92-a0ea73f7ff6d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:54.341698 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f089c-e2cc-4e59-ba92-a0ea73f7ff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:54.449872 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-961f089c-e2cc-4e59-ba92-a0ea73f7ff6d None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:54.451537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-961f089c-e2cc-4e59-ba92-a0ea73f7ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:54.477417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:54.620223 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 507/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 24 08:40:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:59.976031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141058-9b63-4fed-8fad-88b266c37a35 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:59.976914 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141058-9b63-4fed-8fad-88b266c37a35 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:59.977365 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f141058-9b63-4fed-8fad-88b266c37a35 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:59.979034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 522/1029] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 24 08:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:59.985145 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712cd5-a64d-4b6c-93df-34b6b4fb3107 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:59.986224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712cd5-a64d-4b6c-93df-34b6b4fb3107 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:59.986696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712cd5-a64d-4b6c-93df-34b6b4fb3107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:00.096420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-bc712cd5-a64d-4b6c-93df-34b6b4fb3107 None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:00.097675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-bc712cd5-a64d-4b6c-93df-34b6b4fb3107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:00.240321 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:00.298314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 508/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 24 08:40:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:01.728413 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68ea8-c8f2-4d59-906b-3a0bdd1404ce None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:01.729059 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68ea8-c8f2-4d59-906b-3a0bdd1404ce None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:01.729247 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68ea8-c8f2-4d59-906b-3a0bdd1404ce None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:01.730973 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 523/1031] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 24 08:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:41:01.737915 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273e4a1-1cd2-4208-b08c-265fbe575ebc None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:01.738458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273e4a1-1cd2-4208-b08c-265fbe575ebc None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:01.738458 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273e4a1-1cd2-4208-b08c-265fbe575ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:01.835412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-d273e4a1-1cd2-4208-b08c-265fbe575ebc None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:01.836782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-d273e4a1-1cd2-4208-b08c-265fbe575ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:01.991346 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 509/1032] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 24 08:41:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:05.642155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439182-368b-4e9a-82c1-64d4874c2359 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:05.642155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439182-368b-4e9a-82c1-64d4874c2359 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:05.642155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439182-368b-4e9a-82c1-64d4874c2359 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:05.644797 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 524/1033] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:05.651553 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242a73-96f3-436a-8d45-974a2865ff16 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:05.652044 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242a73-96f3-436a-8d45-974a2865ff16 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:05.652522 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242a73-96f3-436a-8d45-974a2865ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:05.718933 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:05.771587 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-ab242a73-96f3-436a-8d45-974a2865ff16 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:05.773257 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ab242a73-96f3-436a-8d45-974a2865ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:05.918891 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 510/1034] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:06.324293 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1c71-33e6-4869-a51a-9509ff007554 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:06.324506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1c71-33e6-4869-a51a-9509ff007554 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:06.324999 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1c71-33e6-4869-a51a-9509ff007554 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:06.326561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 525/1035] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 24 08:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:06.337910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d944a0-5573-4ae5-b6b7-3565250006b7 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:06.338163 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d944a0-5573-4ae5-b6b7-3565250006b7 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:06.338449 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d944a0-5573-4ae5-b6b7-3565250006b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:06.441278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-f5d944a0-5573-4ae5-b6b7-3565250006b7 None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:06.442552 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f5d944a0-5573-4ae5-b6b7-3565250006b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:06.504300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:06.602069 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 511/1036] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 24 08:41:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:06.612354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1c71-33e6-4869-a51a-9509ff007554 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:06.615010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-59cd1c71-33e6-4869-a51a-9509ff007554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:06.816490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1c71-33e6-4869-a51a-9509ff007554 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:06.916212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:06.984522 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e69fd-676b-4260-b25a-e27e2471d273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:06.985219 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e69fd-676b-4260-b25a-e27e2471d273 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:06.985549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e69fd-676b-4260-b25a-e27e2471d273 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:06.985868 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e69fd-676b-4260-b25a-e27e2471d273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:06.987621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f37e69fd-676b-4260-b25a-e27e2471d273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:07.126775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e69fd-676b-4260-b25a-e27e2471d273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:07.128987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e69fd-676b-4260-b25a-e27e2471d273 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:07.156739 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 526/1037] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:09.876993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582007-06b3-4abd-b64d-c8dd6bcf865b None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:09.877518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582007-06b3-4abd-b64d-c8dd6bcf865b None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:09.877518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582007-06b3-4abd-b64d-c8dd6bcf865b None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:09.879076 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 512/1038] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:09.885142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176540-0012-4a59-9488-97f65c5f2b97 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:09.885763 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176540-0012-4a59-9488-97f65c5f2b97 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:09.885763 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176540-0012-4a59-9488-97f65c5f2b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:10.015502 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-82176540-0012-4a59-9488-97f65c5f2b97 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:10.016755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-82176540-0012-4a59-9488-97f65c5f2b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:10.063581 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:10.157552 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 527/1039] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:10.523047 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58582007-06b3-4abd-b64d-c8dd6bcf865b None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:10.525097 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-58582007-06b3-4abd-b64d-c8dd6bcf865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:10.811160 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58582007-06b3-4abd-b64d-c8dd6bcf865b None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:10.821752 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:10.957777 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445cec2-126d-41ea-a612-82341fd17f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:10.960709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445cec2-126d-41ea-a612-82341fd17f05 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:10.960709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445cec2-126d-41ea-a612-82341fd17f05 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:10.960709 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445cec2-126d-41ea-a612-82341fd17f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:10.961259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6445cec2-126d-41ea-a612-82341fd17f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:11.086340 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445cec2-126d-41ea-a612-82341fd17f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:11.087998 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445cec2-126d-41ea-a612-82341fd17f05 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:11.111406 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 513/1040] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:13.910584 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbad187-a421-4948-bec9-138844476963 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:13.911299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbad187-a421-4948-bec9-138844476963 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:13.911299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbad187-a421-4948-bec9-138844476963 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:13.912940 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 528/1041] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:13.919579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b330-24a9-4a48-a957-ee1e8b7096c2 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:13.920302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b330-24a9-4a48-a957-ee1e8b7096c2 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:13.920302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b330-24a9-4a48-a957-ee1e8b7096c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:13.947523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:14.034701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-0ac2b330-24a9-4a48-a957-ee1e8b7096c2 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:14.037341 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-0ac2b330-24a9-4a48-a957-ee1e8b7096c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:14.179327 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 514/1042] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:14.489715 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4f81-6fb0-487a-8140-47ec27ab002a None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:14.490229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4f81-6fb0-487a-8140-47ec27ab002a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:14.490685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4f81-6fb0-487a-8140-47ec27ab002a None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:14.492524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 529/1043] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 24 08:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:14.499385 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f60c-c1ff-45e2-994a-46cd2db02951 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:14.499694 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f60c-c1ff-45e2-994a-46cd2db02951 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:14.500020 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096f60c-c1ff-45e2-994a-46cd2db02951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:14.596723 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-4096f60c-c1ff-45e2-994a-46cd2db02951 None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:14.598223 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4096f60c-c1ff-45e2-994a-46cd2db02951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:14.646373 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:14.761302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 515/1044] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 24 08:41:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:14.770280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b4f81-6fb0-487a-8140-47ec27ab002a None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:14.771967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-4d6b4f81-6fb0-487a-8140-47ec27ab002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:14.933028 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b4f81-6fb0-487a-8140-47ec27ab002a None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:14.954986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:15.102822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e97694-f117-492d-bdcc-5c06b825b62c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:15.103420 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97694-f117-492d-bdcc-5c06b825b62c service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:15.103702 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97694-f117-492d-bdcc-5c06b825b62c service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:15.103962 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97694-f117-492d-bdcc-5c06b825b62c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:15.105924 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-56e97694-f117-492d-bdcc-5c06b825b62c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:15.197758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81439d-873a-4bd0-8555-79c97c577ef9 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:15.198319 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81439d-873a-4bd0-8555-79c97c577ef9 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:15.198319 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81439d-873a-4bd0-8555-79c97c577ef9 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:15.199641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 516/1045] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:15.204921 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a91d4-9262-4169-b767-f7c011845f78 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:15.205206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a91d4-9262-4169-b767-f7c011845f78 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:15.205497 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a91d4-9262-4169-b767-f7c011845f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:15.214577 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e97694-f117-492d-bdcc-5c06b825b62c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:15.216464 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e97694-f117-492d-bdcc-5c06b825b62c service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:15.239200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 530/1046] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:15.299766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-790a91d4-9262-4169-b767-f7c011845f78 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:15.301013 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-790a91d4-9262-4169-b767-f7c011845f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:15.429095 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:15.439332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 517/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:15.743231 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd447e-1644-4b32-a219-5a223a6b13cd None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:15.743533 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd447e-1644-4b32-a219-5a223a6b13cd None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:15.744053 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd447e-1644-4b32-a219-5a223a6b13cd None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:15.745567 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 531/1048] 10.222.0.23 () {54 vars in 963 bytes} [Mon Oct 24 08:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:15.750581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b3a9c-2a96-4c24-9ff2-3b88651e10f2 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:15.750868 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b3a9c-2a96-4c24-9ff2-3b88651e10f2 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:15.751146 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b3a9c-2a96-4c24-9ff2-3b88651e10f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:15.837114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-2e1b3a9c-2a96-4c24-9ff2-3b88651e10f2 None None] MFA Rules not processed for user `f1e86459f94d403bbec3b2f4dc56c458`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:15.838480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-2e1b3a9c-2a96-4c24-9ff2-3b88651e10f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:15.920565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 518/1049] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Oct 24 08:41:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:15.928913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd447e-1644-4b32-a219-5a223a6b13cd None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:15.930742 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e9cd447e-1644-4b32-a219-5a223a6b13cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:15.977739 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:16.070902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd447e-1644-4b32-a219-5a223a6b13cd None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:16.169737 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94ff60-2f32-456b-bf79-2b1adfa33f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e86459f94d403bbec3b2f4dc56c458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:16.170377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ff60-2f32-456b-bf79-2b1adfa33f31 service cinder] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:16.170663 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ff60-2f32-456b-bf79-2b1adfa33f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:16.170890 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ff60-2f32-456b-bf79-2b1adfa33f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:16.172576 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-4e94ff60-2f32-456b-bf79-2b1adfa33f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:16.262992 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:16.311078 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94ff60-2f32-456b-bf79-2b1adfa33f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:16.312340 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94ff60-2f32-456b-bf79-2b1adfa33f31 service cinder] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:16.345851 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 532/1050] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:41:17.934972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80cbf-6ee5-42d0-9c24-426f32298923 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:17.937385 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80cbf-6ee5-42d0-9c24-426f32298923 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:17.937385 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80cbf-6ee5-42d0-9c24-426f32298923 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:17.937385 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 519/1051] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:17.943287 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dfb4e-f56e-4c63-a889-a1efbc07820d None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:17.943841 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dfb4e-f56e-4c63-a889-a1efbc07820d None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:17.943841 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dfb4e-f56e-4c63-a889-a1efbc07820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:18.030087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-6c9dfb4e-f56e-4c63-a889-a1efbc07820d None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:18.031351 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-6c9dfb4e-f56e-4c63-a889-a1efbc07820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:18.153901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 533/1052] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:18.446788 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80cbf-6ee5-42d0-9c24-426f32298923 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:18.448335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-19d80cbf-6ee5-42d0-9c24-426f32298923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:18.547060 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:18.614887 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80cbf-6ee5-42d0-9c24-426f32298923 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:18.742522 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a909ede-b4c6-4d67-9387-9587aefe3715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:18.743135 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909ede-b4c6-4d67-9387-9587aefe3715 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:18.743412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909ede-b4c6-4d67-9387-9587aefe3715 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:18.743677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909ede-b4c6-4d67-9387-9587aefe3715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:18.745751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-9a909ede-b4c6-4d67-9387-9587aefe3715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:18.799753 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:18.846416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a909ede-b4c6-4d67-9387-9587aefe3715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:18.848026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a909ede-b4c6-4d67-9387-9587aefe3715 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:18.867637 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 520/1053] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:21.166968 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dbf12-e360-4786-8e6b-8fc158214255 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:21.167493 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dbf12-e360-4786-8e6b-8fc158214255 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:21.167493 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dbf12-e360-4786-8e6b-8fc158214255 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:21.169004 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 534/1054] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:21.174356 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a981bf7-021c-483c-aff9-c3595df8e2ae None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:21.174787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a981bf7-021c-483c-aff9-c3595df8e2ae None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:21.174884 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a981bf7-021c-483c-aff9-c3595df8e2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:21.248912 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-6a981bf7-021c-483c-aff9-c3595df8e2ae None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:21.250945 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6a981bf7-021c-483c-aff9-c3595df8e2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:21.356138 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 521/1055] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:21.647998 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dbf12-e360-4786-8e6b-8fc158214255 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:21.649639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-092dbf12-e360-4786-8e6b-8fc158214255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:21.689540 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:21.807003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dbf12-e360-4786-8e6b-8fc158214255 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:21.923352 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:21.929726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143f69f-7423-4bd5-a5f8-84257ec8500d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:21.930334 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f69f-7423-4bd5-a5f8-84257ec8500d service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:21.930607 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f69f-7423-4bd5-a5f8-84257ec8500d service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:21.930875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f69f-7423-4bd5-a5f8-84257ec8500d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:21.932495 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f143f69f-7423-4bd5-a5f8-84257ec8500d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:22.035972 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143f69f-7423-4bd5-a5f8-84257ec8500d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:22.038096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143f69f-7423-4bd5-a5f8-84257ec8500d service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:22.057867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 535/1056] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:24.361518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52c98-ad3d-4fef-857f-77c9cc95eab0 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:24.362264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52c98-ad3d-4fef-857f-77c9cc95eab0 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:24.362264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52c98-ad3d-4fef-857f-77c9cc95eab0 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:24.363607 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 522/1057] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:24.369976 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d243-2d6c-4868-b9c7-7797a3d42e27 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:24.370485 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d243-2d6c-4868-b9c7-7797a3d42e27 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:24.370593 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d243-2d6c-4868-b9c7-7797a3d42e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:24.443796 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-b908d243-2d6c-4868-b9c7-7797a3d42e27 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:24.445178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-b908d243-2d6c-4868-b9c7-7797a3d42e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:24.525816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:24.563896 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 536/1058] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:24.904474 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52c98-ad3d-4fef-857f-77c9cc95eab0 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:24.906518 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-73f52c98-ad3d-4fef-857f-77c9cc95eab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:24.944378 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:25.086301 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52c98-ad3d-4fef-857f-77c9cc95eab0 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:25.203646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:25.226720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7f404-b55b-487f-9f14-3797cbc8f96e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:25.227487 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7f404-b55b-487f-9f14-3797cbc8f96e service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:25.227850 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7f404-b55b-487f-9f14-3797cbc8f96e service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:25.228192 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7f404-b55b-487f-9f14-3797cbc8f96e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:25.230299 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-1cd7f404-b55b-487f-9f14-3797cbc8f96e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:25.343432 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7f404-b55b-487f-9f14-3797cbc8f96e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:25.345140 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7f404-b55b-487f-9f14-3797cbc8f96e service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:25.363945 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 523/1059] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:27.983370 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23e80-19ba-491d-bd15-bf5d8c37c34a None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:27.983855 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23e80-19ba-491d-bd15-bf5d8c37c34a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:27.983961 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23e80-19ba-491d-bd15-bf5d8c37c34a None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:27.985325 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 537/1060] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:27.994605 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e57905-b81c-4612-ba35-67606e9d20f0 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:27.995418 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e57905-b81c-4612-ba35-67606e9d20f0 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:27.995567 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e57905-b81c-4612-ba35-67606e9d20f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:28.089791 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-65e57905-b81c-4612-ba35-67606e9d20f0 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:28.091019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-65e57905-b81c-4612-ba35-67606e9d20f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:28.167332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:28.225521 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 524/1061] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:28.523758 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef23e80-19ba-491d-bd15-bf5d8c37c34a None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:28.525692 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-1ef23e80-19ba-491d-bd15-bf5d8c37c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:28.721709 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef23e80-19ba-491d-bd15-bf5d8c37c34a None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:28.804954 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:28.882127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326cf0-9453-4e26-9d57-39c8ca08d147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:28.882757 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326cf0-9453-4e26-9d57-39c8ca08d147 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:28.883031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326cf0-9453-4e26-9d57-39c8ca08d147 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:28.883321 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326cf0-9453-4e26-9d57-39c8ca08d147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:28.885022 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-88326cf0-9453-4e26-9d57-39c8ca08d147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:29.035767 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326cf0-9453-4e26-9d57-39c8ca08d147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:29.039067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326cf0-9453-4e26-9d57-39c8ca08d147 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:29.066155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 538/1062] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:31.420996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642cd4f-cc4c-4c96-8d22-9ee0eecbe705 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:31.421655 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642cd4f-cc4c-4c96-8d22-9ee0eecbe705 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:31.421655 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642cd4f-cc4c-4c96-8d22-9ee0eecbe705 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:31.422936 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 525/1063] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:31.430283 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c41a-ce70-49f9-bcde-4e3cd8ba9142 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:31.430813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c41a-ce70-49f9-bcde-4e3cd8ba9142 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:31.431274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264c41a-ce70-49f9-bcde-4e3cd8ba9142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:31.517854 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-b264c41a-ce70-49f9-bcde-4e3cd8ba9142 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:31.519098 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-b264c41a-ce70-49f9-bcde-4e3cd8ba9142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:31.529147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:31.647046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 539/1064] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:31.947520 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c18c-df76-4c2d-b109-3f4b29bb3582 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:31.947882 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c18c-df76-4c2d-b109-3f4b29bb3582 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:31.948237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c18c-df76-4c2d-b109-3f4b29bb3582 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:31.949875 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 526/1065] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:31.954041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c41a-ce70-49f9-bcde-4e3cd8ba9142 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:31.955425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-b264c41a-ce70-49f9-bcde-4e3cd8ba9142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:31.955991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671315-e78b-4feb-94b0-954f641af193 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:31.956366 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671315-e78b-4feb-94b0-954f641af193 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:31.956757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671315-e78b-4feb-94b0-954f641af193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:32.041848 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-8c671315-e78b-4feb-94b0-954f641af193 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:32.042979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-8c671315-e78b-4feb-94b0-954f641af193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:32.095133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264c41a-ce70-49f9-bcde-4e3cd8ba9142 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:32.126591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:32.165476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 527/1066] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:32.228551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f58083-ea76-455c-96e6-80c7f17bcaad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:32.229148 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f58083-ea76-455c-96e6-80c7f17bcaad service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:32.229428 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f58083-ea76-455c-96e6-80c7f17bcaad service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:32.229785 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f58083-ea76-455c-96e6-80c7f17bcaad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:32.231531 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-33f58083-ea76-455c-96e6-80c7f17bcaad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:32.344282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f58083-ea76-455c-96e6-80c7f17bcaad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:32.346062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f58083-ea76-455c-96e6-80c7f17bcaad service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:32.365999 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 540/1067] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:32.498677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166c13-d0cc-4603-8793-804e5ca088c0 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:32.499245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166c13-d0cc-4603-8793-804e5ca088c0 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:32.499245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a166c13-d0cc-4603-8793-804e5ca088c0 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:32.501049 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 528/1068] 10.222.0.23 () {54 vars in 962 bytes} [Mon Oct 24 08:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:32.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74269d38-9266-42b3-b7d3-6059512f702e None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:32.511170 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74269d38-9266-42b3-b7d3-6059512f702e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:32.511170 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74269d38-9266-42b3-b7d3-6059512f702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:32.555932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:32.620375 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-74269d38-9266-42b3-b7d3-6059512f702e None None] MFA Rules not processed for user `ed5dfb8c97854d37b07ef8474a54e483`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:32.621764 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-74269d38-9266-42b3-b7d3-6059512f702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:32.730517 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 541/1069] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Oct 24 08:41:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:32.741122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166c13-d0cc-4603-8793-804e5ca088c0 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:32.742735 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-0a166c13-d0cc-4603-8793-804e5ca088c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:32.806285 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:32.888558 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a166c13-d0cc-4603-8793-804e5ca088c0 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:32.997942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86600b02-2984-48a4-af8a-0a3d03e6933a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5dfb8c97854d37b07ef8474a54e483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:32.998564 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600b02-2984-48a4-af8a-0a3d03e6933a service glance] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:32.998833 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600b02-2984-48a4-af8a-0a3d03e6933a service glance] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:32.999158 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600b02-2984-48a4-af8a-0a3d03e6933a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:33.001103 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-86600b02-2984-48a4-af8a-0a3d03e6933a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:33.119500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:33.144111 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86600b02-2984-48a4-af8a-0a3d03e6933a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:33.145843 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86600b02-2984-48a4-af8a-0a3d03e6933a service glance] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:33.169047 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 529/1070] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:34.088297 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ee68-c436-4e0a-bb35-ce21e043c65c None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:34.088829 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ee68-c436-4e0a-bb35-ce21e043c65c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:34.089283 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ee68-c436-4e0a-bb35-ce21e043c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:34.183910 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-a2c1ee68-c436-4e0a-bb35-ce21e043c65c None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:34.185294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-a2c1ee68-c436-4e0a-bb35-ce21e043c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:34.278090 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:34.294932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 542/1071] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:41:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:34.345300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec4a7-1ceb-4878-bf65-5e0ffb279654 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:34.345927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec4a7-1ceb-4878-bf65-5e0ffb279654 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:34.345927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ec4a7-1ceb-4878-bf65-5e0ffb279654 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:34.347434 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 530/1072] 10.222.0.23 () {54 vars in 943 bytes} [Mon Oct 24 08:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:34.355305 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff01f95-6290-4edc-b357-137df759f2d2 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:34.355708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff01f95-6290-4edc-b357-137df759f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:34.355988 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff01f95-6290-4edc-b357-137df759f2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:34.461482 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-4ff01f95-6290-4edc-b357-137df759f2d2 None None] MFA Rules not processed for user `bf84d9f0ae734f04aa277f8624b7bd45`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:34.465414 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-4ff01f95-6290-4edc-b357-137df759f2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:34.610574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 543/1073] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Oct 24 08:41:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:34.623542 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ec4a7-1ceb-4878-bf65-5e0ffb279654 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:34.625146 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-e46ec4a7-1ceb-4878-bf65-5e0ffb279654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:34.838234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ec4a7-1ceb-4878-bf65-5e0ffb279654 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:34.930677 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:34.988384 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:34.989718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:34.989993 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:34.990272 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:34.992329 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:35.006568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdad92-79de-4e04-800e-3e254b94feaa None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:35.006831 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdad92-79de-4e04-800e-3e254b94feaa None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:35.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdad92-79de-4e04-800e-3e254b94feaa None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:35.008649 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 544/1074] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:41:35.015371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121691d-99b8-4a10-8d08-3a244b1eec9f None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:35.015670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121691d-99b8-4a10-8d08-3a244b1eec9f None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:35.015946 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121691d-99b8-4a10-8d08-3a244b1eec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:35.101963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:35.104425 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:35.106664 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:35.116909 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-2121691d-99b8-4a10-8d08-3a244b1eec9f None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:35.117675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 531/1075] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:41:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:41:35.118254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-2121691d-99b8-4a10-8d08-3a244b1eec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:35.262742 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 545/1076] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:35.604591 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:35.605864 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:35.764915 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b471a47-fa93-41ed-b48b-8eedbd927a6c service swift] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:35.778985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:36.005643 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbb6e5-4476-4dcb-a72f-72c28c6cebc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:36.006351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb6e5-4476-4dcb-a72f-72c28c6cebc1 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:36.006628 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb6e5-4476-4dcb-a72f-72c28c6cebc1 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:36.006899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb6e5-4476-4dcb-a72f-72c28c6cebc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:36.008588 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4fcbb6e5-4476-4dcb-a72f-72c28c6cebc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:36.145273 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbb6e5-4476-4dcb-a72f-72c28c6cebc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:36.148325 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbb6e5-4476-4dcb-a72f-72c28c6cebc1 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:36.173130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 532/1077] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:38.657128 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c4eca-9996-477a-82ce-7318812abe11 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:38.657936 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c4eca-9996-477a-82ce-7318812abe11 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:38.657936 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c4eca-9996-477a-82ce-7318812abe11 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:38.659536 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 546/1078] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:38.666511 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be9b3d-be1b-4828-8822-67fefb18e9d9 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:38.667133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be9b3d-be1b-4828-8822-67fefb18e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:38.667133 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be9b3d-be1b-4828-8822-67fefb18e9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:38.688766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:38.769464 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-50be9b3d-be1b-4828-8822-67fefb18e9d9 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:38.771819 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-50be9b3d-be1b-4828-8822-67fefb18e9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:38.903866 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 533/1079] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:39.283527 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c4eca-9996-477a-82ce-7318812abe11 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:39.285627 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-bd8c4eca-9996-477a-82ce-7318812abe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:39.461200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:39.501884 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c4eca-9996-477a-82ce-7318812abe11 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:39.705031 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a046a8-6978-4914-a924-fa15ba987639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:39.705748 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a046a8-6978-4914-a924-fa15ba987639 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:39.705842 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a046a8-6978-4914-a924-fa15ba987639 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:39.706272 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a046a8-6978-4914-a924-fa15ba987639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:39.708061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-85a046a8-6978-4914-a924-fa15ba987639 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:39.854423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:39.858402 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a046a8-6978-4914-a924-fa15ba987639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:39.863560 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a046a8-6978-4914-a924-fa15ba987639 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:39.894565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 547/1080] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:42.316085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46365-6982-424e-9323-72c477252c91 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:42.316708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46365-6982-424e-9323-72c477252c91 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:42.316708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f46365-6982-424e-9323-72c477252c91 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:42.324387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536abb4a-695f-4c0a-8b83-9cad55ed3450 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:42.325065 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536abb4a-695f-4c0a-8b83-9cad55ed3450 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:42.325065 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536abb4a-695f-4c0a-8b83-9cad55ed3450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:42.329984 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 534/1081] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:42 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:41:42.424733 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-536abb4a-695f-4c0a-8b83-9cad55ed3450 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:42.427109 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-536abb4a-695f-4c0a-8b83-9cad55ed3450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:42.565923 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 548/1082] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:42.868816 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f46365-6982-424e-9323-72c477252c91 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:42.870970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-b1f46365-6982-424e-9323-72c477252c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:42.981989 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:43.075283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f46365-6982-424e-9323-72c477252c91 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:43.263460 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd358c9-c7bb-42a9-9591-1113820fd653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:43.264553 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd358c9-c7bb-42a9-9591-1113820fd653 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:43.265056 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd358c9-c7bb-42a9-9591-1113820fd653 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:43.265490 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd358c9-c7bb-42a9-9591-1113820fd653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:43.267214 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-5cd358c9-c7bb-42a9-9591-1113820fd653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:43.337888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:43.378994 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd358c9-c7bb-42a9-9591-1113820fd653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:43.381079 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd358c9-c7bb-42a9-9591-1113820fd653 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:43.402308 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 535/1083] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:45.704534 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a315-0632-4cf5-8722-d456c68ca20e None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:45.705063 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a315-0632-4cf5-8722-d456c68ca20e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:45.705063 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a315-0632-4cf5-8722-d456c68ca20e None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:45.706333 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 549/1084] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:45.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4661f-0f51-4142-8f3e-4f6dd79a685a None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:45.717268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4661f-0f51-4142-8f3e-4f6dd79a685a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:45.717268 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4661f-0f51-4142-8f3e-4f6dd79a685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:45.795738 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-d5d4661f-0f51-4142-8f3e-4f6dd79a685a None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:45.797063 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-d5d4661f-0f51-4142-8f3e-4f6dd79a685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:45.906419 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 536/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:46.218654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a315-0632-4cf5-8722-d456c68ca20e None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:46.220250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-06c1a315-0632-4cf5-8722-d456c68ca20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:46.310922 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:46.393777 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a315-0632-4cf5-8722-d456c68ca20e None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:46.539724 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aca00e-16df-43ff-9c69-3696dd33403b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:46.540611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aca00e-16df-43ff-9c69-3696dd33403b service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:46.540893 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aca00e-16df-43ff-9c69-3696dd33403b service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:46.541161 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aca00e-16df-43ff-9c69-3696dd33403b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:46.542828 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-b4aca00e-16df-43ff-9c69-3696dd33403b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:46.576949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:46.644765 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aca00e-16df-43ff-9c69-3696dd33403b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:46.647047 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aca00e-16df-43ff-9c69-3696dd33403b service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:46.669470 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 550/1086] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:55.906940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=86 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:56.666011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=33 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:59.694318 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5425d-b4fa-44b9-a647-6cc801982758 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:59.694836 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5425d-b4fa-44b9-a647-6cc801982758 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:59.694836 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5425d-b4fa-44b9-a647-6cc801982758 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:59.696147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 537/1087] 10.222.0.23 () {54 vars in 918 bytes} [Mon Oct 24 08:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:59.701274 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384d770-bffe-43ca-9456-471f69d5a756 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:59.701708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384d770-bffe-43ca-9456-471f69d5a756 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:59.701843 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384d770-bffe-43ca-9456-471f69d5a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:59.776641 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-7384d770-bffe-43ca-9456-471f69d5a756 None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:59.777939 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-7384d770-bffe-43ca-9456-471f69d5a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:59.886040 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 551/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Oct 24 08:41:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:59.906573 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06facd1d-cd51-40ed-8312-e85936ea211d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:59.906936 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06facd1d-cd51-40ed-8312-e85936ea211d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:59.907245 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06facd1d-cd51-40ed-8312-e85936ea211d None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:59.908632 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 538/1089] 10.222.0.23 () {54 vars in 918 bytes} [Mon Oct 24 08:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:59.915116 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936a393-f7c8-404e-8ce9-0fd35445d68c None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:59.915464 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936a393-f7c8-404e-8ce9-0fd35445d68c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:59.915901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936a393-f7c8-404e-8ce9-0fd35445d68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:00.008327 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:00.011757 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-2936a393-f7c8-404e-8ce9-0fd35445d68c None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:00.013670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-2936a393-f7c8-404e-8ce9-0fd35445d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:00.136699 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 552/1090] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Oct 24 08:41:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:42:02.766605 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953468-15d7-4a86-acb4-f15cc7237b2a None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:02.767161 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953468-15d7-4a86-acb4-f15cc7237b2a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:02.767265 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953468-15d7-4a86-acb4-f15cc7237b2a None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:02.768589 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 539/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:02.774081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3aab8-9d05-467d-903a-77ba5214bfe9 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:02.774561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3aab8-9d05-467d-903a-77ba5214bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:02.774668 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3aab8-9d05-467d-903a-77ba5214bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:02.850263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-0ff3aab8-9d05-467d-903a-77ba5214bfe9 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:02.851496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-0ff3aab8-9d05-467d-903a-77ba5214bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:02.906697 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:02.950365 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 553/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:03.246562 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21953468-15d7-4a86-acb4-f15cc7237b2a None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:03.248130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-21953468-15d7-4a86-acb4-f15cc7237b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:03.400806 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21953468-15d7-4a86-acb4-f15cc7237b2a None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:03.476235 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:03.516764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b833ec-fb6a-4e39-bcf8-acdb1f3b708b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:03.517360 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b833ec-fb6a-4e39-bcf8-acdb1f3b708b service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:03.517662 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b833ec-fb6a-4e39-bcf8-acdb1f3b708b service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:03.517929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b833ec-fb6a-4e39-bcf8-acdb1f3b708b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:03.519561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-94b833ec-fb6a-4e39-bcf8-acdb1f3b708b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:03.620941 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b833ec-fb6a-4e39-bcf8-acdb1f3b708b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:03.622581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b833ec-fb6a-4e39-bcf8-acdb1f3b708b service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:03.641276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 540/1093] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:04.879243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ce19a-290c-487c-8538-31e458b76454 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:04.879824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ce19a-290c-487c-8538-31e458b76454 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:04.879824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ce19a-290c-487c-8538-31e458b76454 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:04.881130 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 554/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:04.886299 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9053-f6b2-48e2-9254-5bec35d36d75 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:04.886764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9053-f6b2-48e2-9254-5bec35d36d75 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:04.886866 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9053-f6b2-48e2-9254-5bec35d36d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:04.966807 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-4f5c9053-f6b2-48e2-9254-5bec35d36d75 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:04.968256 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4f5c9053-f6b2-48e2-9254-5bec35d36d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:04.999219 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:05.074687 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 541/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:05.227021 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ce19a-290c-487c-8538-31e458b76454 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:05.228519 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-2f7ce19a-290c-487c-8538-31e458b76454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:05.378318 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ce19a-290c-487c-8538-31e458b76454 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:05.420856 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:05.507094 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70710c5c-86c3-4f79-9f78-6ad054a02ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:05.507611 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710c5c-86c3-4f79-9f78-6ad054a02ee5 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:05.507881 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710c5c-86c3-4f79-9f78-6ad054a02ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:05.508142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70710c5c-86c3-4f79-9f78-6ad054a02ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:05.509882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-70710c5c-86c3-4f79-9f78-6ad054a02ee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:05.603964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70710c5c-86c3-4f79-9f78-6ad054a02ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:05.605639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70710c5c-86c3-4f79-9f78-6ad054a02ee5 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:05.625845 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 555/1096] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:06.769889 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a68478-9750-491f-b53f-48a9d167ce5e None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:06.770484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a68478-9750-491f-b53f-48a9d167ce5e None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:06.770484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a68478-9750-491f-b53f-48a9d167ce5e None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:06.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 542/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:06.776989 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d8ca5-89a9-4e17-abae-ded94684e3f4 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:06.777461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d8ca5-89a9-4e17-abae-ded94684e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:06.777572 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d8ca5-89a9-4e17-abae-ded94684e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:06.838218 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:06.864393 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d55d8ca5-89a9-4e17-abae-ded94684e3f4 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:06.865856 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d55d8ca5-89a9-4e17-abae-ded94684e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:06.968294 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 556/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:07.126930 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a68478-9750-491f-b53f-48a9d167ce5e None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:07.128357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-52a68478-9750-491f-b53f-48a9d167ce5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:07.277420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a68478-9750-491f-b53f-48a9d167ce5e None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:07.291637 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:07.396715 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9d7a5-2ef5-4e8e-99e9-a40801843518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:07.397224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9d7a5-2ef5-4e8e-99e9-a40801843518 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:07.397531 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9d7a5-2ef5-4e8e-99e9-a40801843518 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:07.397798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9d7a5-2ef5-4e8e-99e9-a40801843518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:07.399373 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-d0d9d7a5-2ef5-4e8e-99e9-a40801843518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:07.499034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9d7a5-2ef5-4e8e-99e9-a40801843518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:07.500636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9d7a5-2ef5-4e8e-99e9-a40801843518 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:07.518840 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 543/1099] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:08.650338 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec6fe-3250-4b31-886e-0a3a56da0477 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:08.650883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec6fe-3250-4b31-886e-0a3a56da0477 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:08.650883 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec6fe-3250-4b31-886e-0a3a56da0477 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:08.652199 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 557/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:08.657512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8df64-9c50-4fe6-9625-bb96c8c1384c None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:08.657962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8df64-9c50-4fe6-9625-bb96c8c1384c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:08.658112 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8df64-9c50-4fe6-9625-bb96c8c1384c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:08.678335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:08.737200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-d5f8df64-9c50-4fe6-9625-bb96c8c1384c None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:08.738467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-d5f8df64-9c50-4fe6-9625-bb96c8c1384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:08.839902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 544/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:09.001204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec6fe-3250-4b31-886e-0a3a56da0477 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:09.002742 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-025ec6fe-3250-4b31-886e-0a3a56da0477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:09.124412 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:09.161802 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec6fe-3250-4b31-886e-0a3a56da0477 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:09.273783 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb1e3c-dcbf-411f-92d3-a4a8313b85e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:09.274385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb1e3c-dcbf-411f-92d3-a4a8313b85e9 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:09.274657 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb1e3c-dcbf-411f-92d3-a4a8313b85e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:09.274923 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb1e3c-dcbf-411f-92d3-a4a8313b85e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:09.276548 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-c4eb1e3c-dcbf-411f-92d3-a4a8313b85e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:09.355580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:09.370591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb1e3c-dcbf-411f-92d3-a4a8313b85e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:09.372205 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb1e3c-dcbf-411f-92d3-a4a8313b85e9 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:09.391045 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 558/1102] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:10.513911 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc1c6-9aa1-47c2-9c03-1f6718c591e2 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:10.514473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc1c6-9aa1-47c2-9c03-1f6718c591e2 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:10.514473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc1c6-9aa1-47c2-9c03-1f6718c591e2 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:10.515777 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 545/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:10.521196 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394ee0b-cabc-40c0-929b-aa7a6e976da4 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:10.521654 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394ee0b-cabc-40c0-929b-aa7a6e976da4 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:10.521787 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394ee0b-cabc-40c0-929b-aa7a6e976da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:10.600762 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-7394ee0b-cabc-40c0-929b-aa7a6e976da4 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:10.601925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-7394ee0b-cabc-40c0-929b-aa7a6e976da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:10.699376 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 559/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:10.849510 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cc1c6-9aa1-47c2-9c03-1f6718c591e2 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:10.851241 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-da0cc1c6-9aa1-47c2-9c03-1f6718c591e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:10.941831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:11.008198 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cc1c6-9aa1-47c2-9c03-1f6718c591e2 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:11.134189 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd95e7-1fd5-47bd-8be1-d3269714708e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:11.134635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd95e7-1fd5-47bd-8be1-d3269714708e service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:11.134905 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd95e7-1fd5-47bd-8be1-d3269714708e service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:11.135167 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd95e7-1fd5-47bd-8be1-d3269714708e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:11.136736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-d8fd95e7-1fd5-47bd-8be1-d3269714708e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:11.194650 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:11.237780 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd95e7-1fd5-47bd-8be1-d3269714708e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:11.239964 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd95e7-1fd5-47bd-8be1-d3269714708e service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:11.258420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 546/1105] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:12.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb699d-2f16-44ae-bb75-da92b10e6c37 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:12.374448 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb699d-2f16-44ae-bb75-da92b10e6c37 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:12.374448 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb699d-2f16-44ae-bb75-da92b10e6c37 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:12.375731 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 560/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:12.381491 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a9b6-3693-4245-907c-efbb53b12433 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:12.382011 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a9b6-3693-4245-907c-efbb53b12433 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:12.382123 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a9b6-3693-4245-907c-efbb53b12433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:12.486551 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-36f9a9b6-3693-4245-907c-efbb53b12433 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:12.487897 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-36f9a9b6-3693-4245-907c-efbb53b12433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:12.600606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 547/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:12.753901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb699d-2f16-44ae-bb75-da92b10e6c37 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:12.756317 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-ebeb699d-2f16-44ae-bb75-da92b10e6c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:12.809219 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:12.916012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb699d-2f16-44ae-bb75-da92b10e6c37 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:13.044670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32942e-5f87-4c33-9c66-806eae77800a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:13.045276 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32942e-5f87-4c33-9c66-806eae77800a service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:13.045577 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32942e-5f87-4c33-9c66-806eae77800a service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:13.045847 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32942e-5f87-4c33-9c66-806eae77800a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:13.047458 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-ca32942e-5f87-4c33-9c66-806eae77800a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:13.054632 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:13.155420 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32942e-5f87-4c33-9c66-806eae77800a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:13.157054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32942e-5f87-4c33-9c66-806eae77800a service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:13.176476 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 561/1108] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:42:14.293225 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e01c-bbf3-4f4b-ba90-c90ba979cd9d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:14.293820 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e01c-bbf3-4f4b-ba90-c90ba979cd9d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:14.293820 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142e01c-bbf3-4f4b-ba90-c90ba979cd9d None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:14.295129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 548/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:14.300180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af77bf-f90b-4bca-b6b0-990191c33bf4 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:14.300639 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af77bf-f90b-4bca-b6b0-990191c33bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:14.300768 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af77bf-f90b-4bca-b6b0-990191c33bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:14.380867 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d7af77bf-f90b-4bca-b6b0-990191c33bf4 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:14.382187 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d7af77bf-f90b-4bca-b6b0-990191c33bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:14.466809 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:14.499974 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 562/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:14.657002 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142e01c-bbf3-4f4b-ba90-c90ba979cd9d None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:14.658578 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4142e01c-bbf3-4f4b-ba90-c90ba979cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:14.678283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:14.820296 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142e01c-bbf3-4f4b-ba90-c90ba979cd9d None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:14.919278 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:14.945829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99228dd5-29b6-4f78-aa85-483f29093e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:14.946442 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228dd5-29b6-4f78-aa85-483f29093e5d service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:14.946716 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228dd5-29b6-4f78-aa85-483f29093e5d service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:14.946985 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228dd5-29b6-4f78-aa85-483f29093e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:14.948581 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-99228dd5-29b6-4f78-aa85-483f29093e5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:15.050957 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99228dd5-29b6-4f78-aa85-483f29093e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:15.052774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99228dd5-29b6-4f78-aa85-483f29093e5d service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:15.072481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 549/1111] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:16.272441 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcad0c7-8ea2-4050-b9ad-51abc80a53b4 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:16.273036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcad0c7-8ea2-4050-b9ad-51abc80a53b4 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:16.273036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcad0c7-8ea2-4050-b9ad-51abc80a53b4 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:16.274333 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 563/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:16.279267 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f3788-d9d4-4e77-8f32-54a4da30d7ef None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:16.279698 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f3788-d9d4-4e77-8f32-54a4da30d7ef None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:16.279828 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f3788-d9d4-4e77-8f32-54a4da30d7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:16.362080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-683f3788-d9d4-4e77-8f32-54a4da30d7ef None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:16.363497 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-683f3788-d9d4-4e77-8f32-54a4da30d7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:16.419740 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:16.486941 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 550/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:16.666346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcad0c7-8ea2-4050-b9ad-51abc80a53b4 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:16.667780 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-7bcad0c7-8ea2-4050-b9ad-51abc80a53b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:16.811561 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcad0c7-8ea2-4050-b9ad-51abc80a53b4 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:16.868013 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:16.929112 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9872-2700-41bf-a1da-4cfbd86025a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:16.929691 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9872-2700-41bf-a1da-4cfbd86025a1 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:16.929962 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9872-2700-41bf-a1da-4cfbd86025a1 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:16.930229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9872-2700-41bf-a1da-4cfbd86025a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:16.931819 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-34bf9872-2700-41bf-a1da-4cfbd86025a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:17.029499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9872-2700-41bf-a1da-4cfbd86025a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:17.031218 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9872-2700-41bf-a1da-4cfbd86025a1 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:17.051128 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 564/1114] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:18.118430 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa9001-d0b2-4979-b6da-77cb6d0a722c None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:18.119318 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa9001-d0b2-4979-b6da-77cb6d0a722c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:18.119318 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa9001-d0b2-4979-b6da-77cb6d0a722c None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:18.121311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 551/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:18.126575 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd92d1-7abf-414d-ad50-ef9f880d0f16 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:18.127154 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd92d1-7abf-414d-ad50-ef9f880d0f16 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:18.127154 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd92d1-7abf-414d-ad50-ef9f880d0f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:18.208483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-e1dd92d1-7abf-414d-ad50-ef9f880d0f16 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:18.209822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e1dd92d1-7abf-414d-ad50-ef9f880d0f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:18.212139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:18.313017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 565/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:18.464928 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa9001-d0b2-4979-b6da-77cb6d0a722c None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:18.466629 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6afa9001-d0b2-4979-b6da-77cb6d0a722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:18.616074 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa9001-d0b2-4979-b6da-77cb6d0a722c None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:18.643686 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:18.730750 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b309c-f0af-4b68-b033-0cea72967cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:18.731372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b309c-f0af-4b68-b033-0cea72967cc7 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:18.731652 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b309c-f0af-4b68-b033-0cea72967cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:18.732100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b309c-f0af-4b68-b033-0cea72967cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:18.733740 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-7d8b309c-f0af-4b68-b033-0cea72967cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:18.825510 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b309c-f0af-4b68-b033-0cea72967cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:18.827102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b309c-f0af-4b68-b033-0cea72967cc7 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:18.845991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 552/1117] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:21.004273 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447d7b4-6b67-4059-947e-8b94c97d3329 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:21.005110 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447d7b4-6b67-4059-947e-8b94c97d3329 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:21.005384 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447d7b4-6b67-4059-947e-8b94c97d3329 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:21.006759 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 566/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:21.012570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca4a67-733b-4e34-b0b4-aad42ac4fd41 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:21.013064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca4a67-733b-4e34-b0b4-aad42ac4fd41 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:21.013160 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca4a67-733b-4e34-b0b4-aad42ac4fd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:21.057989 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:21.085082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-27ca4a67-733b-4e34-b0b4-aad42ac4fd41 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:21.086302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-27ca4a67-733b-4e34-b0b4-aad42ac4fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:21.198029 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 553/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:21.482613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447d7b4-6b67-4059-947e-8b94c97d3329 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:21.484130 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-1447d7b4-6b67-4059-947e-8b94c97d3329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:21.594649 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447d7b4-6b67-4059-947e-8b94c97d3329 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:21.628108 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:21.669743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cd8bd-d964-4ed2-9019-f2b3e0540c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:21.670404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cd8bd-d964-4ed2-9019-f2b3e0540c05 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:21.670615 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cd8bd-d964-4ed2-9019-f2b3e0540c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:21.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cd8bd-d964-4ed2-9019-f2b3e0540c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:21.672469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-6e9cd8bd-d964-4ed2-9019-f2b3e0540c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:21.784058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cd8bd-d964-4ed2-9019-f2b3e0540c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:21.786036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cd8bd-d964-4ed2-9019-f2b3e0540c05 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:21.804213 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 567/1120] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:24.264554 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373cfe1-55e4-4ff5-a247-346ab20e8e6f None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:24.265101 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373cfe1-55e4-4ff5-a247-346ab20e8e6f None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:24.265101 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373cfe1-55e4-4ff5-a247-346ab20e8e6f None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:24.266475 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 554/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:24.272303 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1413f4-489b-4c1b-a372-ee9733a557a3 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:24.272744 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1413f4-489b-4c1b-a372-ee9733a557a3 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:24.272845 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1413f4-489b-4c1b-a372-ee9733a557a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:24.340535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-7f1413f4-489b-4c1b-a372-ee9733a557a3 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:24.341783 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-7f1413f4-489b-4c1b-a372-ee9733a557a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:24.355468 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:24.444041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 568/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:24.734831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373cfe1-55e4-4ff5-a247-346ab20e8e6f None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:24.736378 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-1373cfe1-55e4-4ff5-a247-346ab20e8e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:24.843724 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373cfe1-55e4-4ff5-a247-346ab20e8e6f None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:24.857412 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:24.925845 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6f3b8-4417-43de-b879-8ec25d7fb98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:24.927570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6f3b8-4417-43de-b879-8ec25d7fb98a service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:24.927844 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6f3b8-4417-43de-b879-8ec25d7fb98a service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:24.928111 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6f3b8-4417-43de-b879-8ec25d7fb98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:24.929893 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-baf6f3b8-4417-43de-b879-8ec25d7fb98a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:25.051414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6f3b8-4417-43de-b879-8ec25d7fb98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:25.052838 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6f3b8-4417-43de-b879-8ec25d7fb98a service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:25.072577 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 555/1123] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:27.607100 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013408b-2188-40ec-bb1d-d1a13616e212 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:27.607617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013408b-2188-40ec-bb1d-d1a13616e212 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:27.607617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013408b-2188-40ec-bb1d-d1a13616e212 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:27.608893 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 569/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:27.614633 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1874-5460-457d-9b30-5b7620ff394f None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:27.615117 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1874-5460-457d-9b30-5b7620ff394f None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:27.615225 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1874-5460-457d-9b30-5b7620ff394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:27.665665 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:27.686966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-f81a1874-5460-457d-9b30-5b7620ff394f None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:27.688198 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f81a1874-5460-457d-9b30-5b7620ff394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:27.790952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 556/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:28.084562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013408b-2188-40ec-bb1d-d1a13616e212 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:28.086822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f013408b-2188-40ec-bb1d-d1a13616e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:28.214599 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013408b-2188-40ec-bb1d-d1a13616e212 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:28.260786 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:28.303400 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cf2a-f566-47d0-9b83-55e453cf1bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:28.304011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cf2a-f566-47d0-9b83-55e453cf1bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:28.304285 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cf2a-f566-47d0-9b83-55e453cf1bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:28.304549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cf2a-f566-47d0-9b83-55e453cf1bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:28.306271 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-5796cf2a-f566-47d0-9b83-55e453cf1bd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:28.442824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cf2a-f566-47d0-9b83-55e453cf1bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:28.444267 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cf2a-f566-47d0-9b83-55e453cf1bd7 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:28.463426 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 570/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:30.875524 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456750-2840-4908-960d-d1cf7b380f44 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:30.876342 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456750-2840-4908-960d-d1cf7b380f44 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:30.876342 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456750-2840-4908-960d-d1cf7b380f44 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:30.877849 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 557/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:42:30.884356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9339-9c58-40ff-83da-6d26fed510bb None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:30.884931 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9339-9c58-40ff-83da-6d26fed510bb None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:30.884931 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9339-9c58-40ff-83da-6d26fed510bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:30.958421 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-a16b9339-9c58-40ff-83da-6d26fed510bb None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:30.959687 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-a16b9339-9c58-40ff-83da-6d26fed510bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:30.990541 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:31.072157 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 571/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:42:31.363311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44456750-2840-4908-960d-d1cf7b380f44 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:31.364881 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-44456750-2840-4908-960d-d1cf7b380f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:31.482809 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44456750-2840-4908-960d-d1cf7b380f44 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:31.508132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:31.585954 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a06f6-afb2-41d3-b5c9-ae6da83de17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:31.586833 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a06f6-afb2-41d3-b5c9-ae6da83de17d service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:31.587283 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a06f6-afb2-41d3-b5c9-ae6da83de17d service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:31.587713 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a06f6-afb2-41d3-b5c9-ae6da83de17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:31.590524 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-516a06f6-afb2-41d3-b5c9-ae6da83de17d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:31.725879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a06f6-afb2-41d3-b5c9-ae6da83de17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:31.727416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a06f6-afb2-41d3-b5c9-ae6da83de17d service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:31.749354 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 558/1129] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:34.214011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641afab7-8409-44f9-a93b-eb13297fa736 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:34.214597 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641afab7-8409-44f9-a93b-eb13297fa736 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:34.214880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641afab7-8409-44f9-a93b-eb13297fa736 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:34.216784 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 572/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:34.222987 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae28c-f6b2-43a6-8f1d-5752dcb7825e None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:34.224338 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae28c-f6b2-43a6-8f1d-5752dcb7825e None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:34.224338 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae28c-f6b2-43a6-8f1d-5752dcb7825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:34.295684 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:34.298880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-68dae28c-f6b2-43a6-8f1d-5752dcb7825e None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:34.301535 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-68dae28c-f6b2-43a6-8f1d-5752dcb7825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:34.401343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 559/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:34.690087 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641afab7-8409-44f9-a93b-eb13297fa736 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:34.691696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-641afab7-8409-44f9-a93b-eb13297fa736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:34.808528 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641afab7-8409-44f9-a93b-eb13297fa736 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:34.862012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:34.889634 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81037522-5ae6-4fdc-8cd6-65de58d4ac40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:34.890249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81037522-5ae6-4fdc-8cd6-65de58d4ac40 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:34.890525 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81037522-5ae6-4fdc-8cd6-65de58d4ac40 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:34.890795 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81037522-5ae6-4fdc-8cd6-65de58d4ac40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:34.892413 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-81037522-5ae6-4fdc-8cd6-65de58d4ac40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:35.025695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81037522-5ae6-4fdc-8cd6-65de58d4ac40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:35.027200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81037522-5ae6-4fdc-8cd6-65de58d4ac40 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:35.049806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 573/1132] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:37.398104 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822438-d6c4-4047-a043-1121b3b1e38d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:37.398654 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822438-d6c4-4047-a043-1121b3b1e38d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:37.398654 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822438-d6c4-4047-a043-1121b3b1e38d None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:37.400049 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 560/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:37.405643 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5411183-dc7a-4fbf-ba55-c70117929f03 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:37.406092 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5411183-dc7a-4fbf-ba55-c70117929f03 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:37.406186 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5411183-dc7a-4fbf-ba55-c70117929f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:37.477243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-f5411183-dc7a-4fbf-ba55-c70117929f03 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:37.478488 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f5411183-dc7a-4fbf-ba55-c70117929f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:37.509222 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:37.580487 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 574/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:37.863734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed822438-d6c4-4047-a043-1121b3b1e38d None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:37.865242 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ed822438-d6c4-4047-a043-1121b3b1e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:37.973866 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed822438-d6c4-4047-a043-1121b3b1e38d None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:38.006931 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:38.053914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e77564-3e90-4f9b-b681-25c3f25b91a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:38.054515 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e77564-3e90-4f9b-b681-25c3f25b91a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:38.054792 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e77564-3e90-4f9b-b681-25c3f25b91a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:38.055060 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e77564-3e90-4f9b-b681-25c3f25b91a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:38.056648 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-69e77564-3e90-4f9b-b681-25c3f25b91a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:38.166484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e77564-3e90-4f9b-b681-25c3f25b91a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:38.167820 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e77564-3e90-4f9b-b681-25c3f25b91a0 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:38.186194 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 561/1135] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:40.560757 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771fb3-5b7f-4459-99ad-549cce2e7c19 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:40.561602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771fb3-5b7f-4459-99ad-549cce2e7c19 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:40.561602 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771fb3-5b7f-4459-99ad-549cce2e7c19 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:40.562726 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 575/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:40.569472 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9abbd-1a91-41b6-857d-d2a0f7ca42a7 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:40.569991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9abbd-1a91-41b6-857d-d2a0f7ca42a7 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:40.569991 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9abbd-1a91-41b6-857d-d2a0f7ca42a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:40.639530 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-1cd9abbd-1a91-41b6-857d-d2a0f7ca42a7 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:40.640725 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-1cd9abbd-1a91-41b6-857d-d2a0f7ca42a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:40.649154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:40.740486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 562/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:41.033575 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96771fb3-5b7f-4459-99ad-549cce2e7c19 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:41.035630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-96771fb3-5b7f-4459-99ad-549cce2e7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:41.139773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96771fb3-5b7f-4459-99ad-549cce2e7c19 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:41.196056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:41.215212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdf25a-2a8e-4401-b9f2-668ada821c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:41.215810 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdf25a-2a8e-4401-b9f2-668ada821c29 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:41.216081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdf25a-2a8e-4401-b9f2-668ada821c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:41.216345 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdf25a-2a8e-4401-b9f2-668ada821c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:41.217944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-22cdf25a-2a8e-4401-b9f2-668ada821c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:41.330068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdf25a-2a8e-4401-b9f2-668ada821c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:41.331501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdf25a-2a8e-4401-b9f2-668ada821c29 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:41.350801 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 576/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:43.610826 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df767-fa7f-49d7-9657-74a19d41995d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:43.611409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df767-fa7f-49d7-9657-74a19d41995d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:43.611409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df767-fa7f-49d7-9657-74a19d41995d None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:43.612702 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 563/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:43.620536 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846e57-1fbb-4a0b-8430-b3960bb98c53 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:43.621379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846e57-1fbb-4a0b-8430-b3960bb98c53 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:43.621379 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846e57-1fbb-4a0b-8430-b3960bb98c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:43.700249 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-45846e57-1fbb-4a0b-8430-b3960bb98c53 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:43.701516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-45846e57-1fbb-4a0b-8430-b3960bb98c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:43.745405 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:43.808555 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 577/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:42:44.104213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df767-fa7f-49d7-9657-74a19d41995d None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:44.105798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-fa5df767-fa7f-49d7-9657-74a19d41995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:44.212224 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df767-fa7f-49d7-9657-74a19d41995d None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:44.249565 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:44.287425 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112085a-2322-4f4d-8901-2521d59fe098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:44.288018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112085a-2322-4f4d-8901-2521d59fe098 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:44.288289 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112085a-2322-4f4d-8901-2521d59fe098 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:44.288552 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112085a-2322-4f4d-8901-2521d59fe098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:44.290190 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-e112085a-2322-4f4d-8901-2521d59fe098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:44.400986 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112085a-2322-4f4d-8901-2521d59fe098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:44.402494 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112085a-2322-4f4d-8901-2521d59fe098 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:44.421322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 564/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:46.693132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2625b-f71b-4a98-9812-0aa89c521b53 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:46.693745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2625b-f71b-4a98-9812-0aa89c521b53 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:46.693745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2625b-f71b-4a98-9812-0aa89c521b53 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:46.695044 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 578/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:46.700814 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd974b0-5991-4437-8860-bc9a91b5458c None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:46.701370 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd974b0-5991-4437-8860-bc9a91b5458c None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:46.701370 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd974b0-5991-4437-8860-bc9a91b5458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:46.770512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-0fd974b0-5991-4437-8860-bc9a91b5458c None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:46.771755 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-0fd974b0-5991-4437-8860-bc9a91b5458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:46.790614 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:46.874929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 565/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:47.164193 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2625b-f71b-4a98-9812-0aa89c521b53 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:47.165792 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-75f2625b-f71b-4a98-9812-0aa89c521b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:47.279143 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2625b-f71b-4a98-9812-0aa89c521b53 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:47.357887 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:47.367048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f602f2-5af6-4c1a-bb9e-94ab6742dd3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:47.367944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f602f2-5af6-4c1a-bb9e-94ab6742dd3c service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:47.367944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f602f2-5af6-4c1a-bb9e-94ab6742dd3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:47.368169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f602f2-5af6-4c1a-bb9e-94ab6742dd3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:47.369917 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e9f602f2-5af6-4c1a-bb9e-94ab6742dd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:47.501949 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f602f2-5af6-4c1a-bb9e-94ab6742dd3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:47.503393 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f602f2-5af6-4c1a-bb9e-94ab6742dd3c service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:47.522712 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 579/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:49.793814 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d764e4-de6d-43cd-a5da-4dca83fe2cfc None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:49.794383 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d764e4-de6d-43cd-a5da-4dca83fe2cfc None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:49.794383 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d764e4-de6d-43cd-a5da-4dca83fe2cfc None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:49.795845 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 566/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:49.801750 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63df67a-254c-4075-9be6-6ac0b3581921 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:49.802304 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63df67a-254c-4075-9be6-6ac0b3581921 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:49.802304 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63df67a-254c-4075-9be6-6ac0b3581921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:49.870281 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-e63df67a-254c-4075-9be6-6ac0b3581921 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:49.871771 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e63df67a-254c-4075-9be6-6ac0b3581921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:49.920143 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:49.973142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 580/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:42:50.262484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d764e4-de6d-43cd-a5da-4dca83fe2cfc None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:50.264057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-90d764e4-de6d-43cd-a5da-4dca83fe2cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:50.376186 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d764e4-de6d-43cd-a5da-4dca83fe2cfc None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:50.425115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:50.455362 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902aa63d-9cea-480b-b5ab-3882eddbe342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:50.455982 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aa63d-9cea-480b-b5ab-3882eddbe342 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:50.456251 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aa63d-9cea-480b-b5ab-3882eddbe342 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:50.456512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aa63d-9cea-480b-b5ab-3882eddbe342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:50.459310 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-902aa63d-9cea-480b-b5ab-3882eddbe342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:50.584116 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902aa63d-9cea-480b-b5ab-3882eddbe342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:50.585596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902aa63d-9cea-480b-b5ab-3882eddbe342 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:50.605947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 567/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:59.971728 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=22 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:00.603602 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=66 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:11.273142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e758cd-faa7-49e0-9afe-c9f47025fbb1 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:11.273773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e758cd-faa7-49e0-9afe-c9f47025fbb1 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:11.273773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e758cd-faa7-49e0-9afe-c9f47025fbb1 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:11.275061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 581/1148] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:11.280914 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287355-25ee-49bf-a74d-318302f49d17 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:11.281428 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287355-25ee-49bf-a74d-318302f49d17 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:11.281557 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287355-25ee-49bf-a74d-318302f49d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:11.353362 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-48287355-25ee-49bf-a74d-318302f49d17 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:11.354614 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-48287355-25ee-49bf-a74d-318302f49d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:11.457861 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 568/1149] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:11.764933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5e1a5-87b5-426b-9403-b861256fe284 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:11.765211 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5e1a5-87b5-426b-9403-b861256fe284 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:11.765507 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5e1a5-87b5-426b-9403-b861256fe284 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:11.766824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 582/1150] 10.222.0.23 () {54 vars in 962 bytes} [Mon Oct 24 08:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:11.772957 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896fc0-1a7e-4d44-8db8-f86e57c718d0 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:11.773236 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896fc0-1a7e-4d44-8db8-f86e57c718d0 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:11.773533 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896fc0-1a7e-4d44-8db8-f86e57c718d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:11.857349 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-77896fc0-1a7e-4d44-8db8-f86e57c718d0 None None] MFA Rules not processed for user `ed5dfb8c97854d37b07ef8474a54e483`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:11.858601 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-77896fc0-1a7e-4d44-8db8-f86e57c718d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:11.881306 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:11.940243 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 569/1151] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Oct 24 08:43:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:11.949397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5e1a5-87b5-426b-9403-b861256fe284 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:11.950986 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-afa5e1a5-87b5-426b-9403-b861256fe284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:12.064050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5e1a5-87b5-426b-9403-b861256fe284 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:12.147621 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c3e1-31b9-41be-96e8-9d39e3b6aca9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5dfb8c97854d37b07ef8474a54e483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:12.148229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c3e1-31b9-41be-96e8-9d39e3b6aca9 service glance] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:12.148506 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c3e1-31b9-41be-96e8-9d39e3b6aca9 service glance] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:12.148776 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c3e1-31b9-41be-96e8-9d39e3b6aca9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:12.150467 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-c927c3e1-31b9-41be-96e8-9d39e3b6aca9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:12.207806 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:12.267637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c3e1-31b9-41be-96e8-9d39e3b6aca9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:12.269123 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c3e1-31b9-41be-96e8-9d39e3b6aca9 service glance] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:12.291768 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 583/1152] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:14.670708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dd1de-03e5-4328-9df4-80b224d02408 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:14.671316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dd1de-03e5-4328-9df4-80b224d02408 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:14.671447 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dd1de-03e5-4328-9df4-80b224d02408 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:14.672859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 570/1153] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:14.678442 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79db4-746d-4709-9b89-f7dfc4c64328 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:14.678933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79db4-746d-4709-9b89-f7dfc4c64328 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:14.679036 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea79db4-746d-4709-9b89-f7dfc4c64328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:14.749132 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-3ea79db4-746d-4709-9b89-f7dfc4c64328 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:14.750392 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-3ea79db4-746d-4709-9b89-f7dfc4c64328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:14.849762 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 584/1154] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:15.128156 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dd1de-03e5-4328-9df4-80b224d02408 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:15.130434 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6c4dd1de-03e5-4328-9df4-80b224d02408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:15.264249 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dd1de-03e5-4328-9df4-80b224d02408 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:15.317734 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:15.367381 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7e8fd-d737-48e4-a666-d3faec2f0e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:15.367986 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e8fd-d737-48e4-a666-d3faec2f0e16 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:15.368259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e8fd-d737-48e4-a666-d3faec2f0e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:15.368523 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7e8fd-d737-48e4-a666-d3faec2f0e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:15.369153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7e8fd-d737-48e4-a666-d3faec2f0e16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:15.370297 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING py.warnings [None req-84b7e8fd-d737-48e4-a666-d3faec2f0e16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:43:15.370297 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: warnings.warn(msg) Oct 24 08:43:15.370297 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: Oct 24 08:43:15.371717 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7e8fd-d737-48e4-a666-d3faec2f0e16 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:15.391064 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 571/1155] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Oct 24 08:43:15 2022] GET /identity/v3/projects => generated 2553 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:43:17.664963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1b6d-dd34-4314-83b8-e5319c15886b None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:17.665575 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1b6d-dd34-4314-83b8-e5319c15886b None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:17.665575 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1b6d-dd34-4314-83b8-e5319c15886b None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:17.666778 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 585/1156] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:17.672560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714ac3-9d7e-449b-bf2e-6e8cc5999836 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:17.673088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714ac3-9d7e-449b-bf2e-6e8cc5999836 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:17.673190 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714ac3-9d7e-449b-bf2e-6e8cc5999836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:17.744950 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-76714ac3-9d7e-449b-bf2e-6e8cc5999836 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:17.746430 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-76714ac3-9d7e-449b-bf2e-6e8cc5999836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:17.860859 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 572/1157] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:18.173209 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1b6d-dd34-4314-83b8-e5319c15886b None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:18.174824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-996c1b6d-dd34-4314-83b8-e5319c15886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:18.185854 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:18.346311 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1b6d-dd34-4314-83b8-e5319c15886b None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:18.448444 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:18.486264 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452732-a656-4bb6-80f4-afc4f45ccb0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:18.486877 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452732-a656-4bb6-80f4-afc4f45ccb0a service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:18.487151 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452732-a656-4bb6-80f4-afc4f45ccb0a service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:18.487416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452732-a656-4bb6-80f4-afc4f45ccb0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:18.490313 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-a5452732-a656-4bb6-80f4-afc4f45ccb0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:18.592956 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5452732-a656-4bb6-80f4-afc4f45ccb0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:18.594606 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5452732-a656-4bb6-80f4-afc4f45ccb0a service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:18.616339 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 586/1158] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:43:21.083132 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc28d-731a-494f-9aaf-7dce4b8ecfeb None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:21.083710 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc28d-731a-494f-9aaf-7dce4b8ecfeb None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:21.083710 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc28d-731a-494f-9aaf-7dce4b8ecfeb None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:21.085080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 573/1159] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:21.090859 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bf8fa-da3e-4048-b751-e6a8de4f791a None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:21.091299 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bf8fa-da3e-4048-b751-e6a8de4f791a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:21.091551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bf8fa-da3e-4048-b751-e6a8de4f791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:21.162088 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-105bf8fa-da3e-4048-b751-e6a8de4f791a None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:21.163302 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-105bf8fa-da3e-4048-b751-e6a8de4f791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:21.211597 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:21.263115 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 587/1160] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:21.554088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dc28d-731a-494f-9aaf-7dce4b8ecfeb None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:21.555646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-1f4dc28d-731a-494f-9aaf-7dce4b8ecfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:21.580944 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:21.665717 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dc28d-731a-494f-9aaf-7dce4b8ecfeb None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:21.745963 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f3b6f-753c-4c2d-b977-9931b64a4fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:21.746812 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f3b6f-753c-4c2d-b977-9931b64a4fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:21.747085 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f3b6f-753c-4c2d-b977-9931b64a4fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:21.747346 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f3b6f-753c-4c2d-b977-9931b64a4fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:21.748938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-554f3b6f-753c-4c2d-b977-9931b64a4fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:21.830089 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:21.869708 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f3b6f-753c-4c2d-b977-9931b64a4fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:21.871635 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f3b6f-753c-4c2d-b977-9931b64a4fd7 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:21.891171 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 574/1161] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:43:24.164884 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a25ec8-bff7-4113-8346-d035f4f0dfc5 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:24.165418 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a25ec8-bff7-4113-8346-d035f4f0dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:24.165418 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a25ec8-bff7-4113-8346-d035f4f0dfc5 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:24.166793 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 588/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:24.172274 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b256f5-80a3-4dbd-9f86-843ae3af52d7 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:24.172722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b256f5-80a3-4dbd-9f86-843ae3af52d7 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:24.172833 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b256f5-80a3-4dbd-9f86-843ae3af52d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:24.240408 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-b9b256f5-80a3-4dbd-9f86-843ae3af52d7 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:24.241588 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-b9b256f5-80a3-4dbd-9f86-843ae3af52d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:24.342182 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 575/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:43:24.636032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a25ec8-bff7-4113-8346-d035f4f0dfc5 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:24.637728 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f5a25ec8-bff7-4113-8346-d035f4f0dfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:24.748434 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a25ec8-bff7-4113-8346-d035f4f0dfc5 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:24.831637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:24.833339 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e0cad-f3fd-4757-b66c-3ff329868548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:24.834097 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0cad-f3fd-4757-b66c-3ff329868548 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:24.834387 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0cad-f3fd-4757-b66c-3ff329868548 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:24.834872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0cad-f3fd-4757-b66c-3ff329868548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:24.836836 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d23e0cad-f3fd-4757-b66c-3ff329868548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:24.995721 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e0cad-f3fd-4757-b66c-3ff329868548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:24.997882 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e0cad-f3fd-4757-b66c-3ff329868548 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:25.018254 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 589/1164] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:27.399968 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddbdd2-2a6d-4026-9a4a-2071dfc94543 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:27.400575 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddbdd2-2a6d-4026-9a4a-2071dfc94543 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:27.400575 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddbdd2-2a6d-4026-9a4a-2071dfc94543 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:27.401892 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 576/1165] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:27.407727 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d395-60c3-43e3-bb0e-0019b4ff146b None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:27.408276 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d395-60c3-43e3-bb0e-0019b4ff146b None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:27.408276 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0d395-60c3-43e3-bb0e-0019b4ff146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:27.486873 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-a5f0d395-60c3-43e3-bb0e-0019b4ff146b None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:27.488585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-a5f0d395-60c3-43e3-bb0e-0019b4ff146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:27.550325 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:27.601875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 590/1166] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:43:28.022109 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddbdd2-2a6d-4026-9a4a-2071dfc94543 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:28.023692 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ebddbdd2-2a6d-4026-9a4a-2071dfc94543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:28.064744 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:28.142802 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddbdd2-2a6d-4026-9a4a-2071dfc94543 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:28.236184 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb0dd-634b-415e-a6b1-6ec2f97c40c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:28.237058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb0dd-634b-415e-a6b1-6ec2f97c40c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:28.238088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb0dd-634b-415e-a6b1-6ec2f97c40c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:28.238576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb0dd-634b-415e-a6b1-6ec2f97c40c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:28.241644 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-461eb0dd-634b-415e-a6b1-6ec2f97c40c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:28.357420 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:28.399902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eb0dd-634b-415e-a6b1-6ec2f97c40c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:28.401377 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eb0dd-634b-415e-a6b1-6ec2f97c40c5 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:28.423269 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 577/1167] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:31.152071 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698506-5ef7-4b44-8235-93fc6ed15967 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:31.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698506-5ef7-4b44-8235-93fc6ed15967 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:31.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698506-5ef7-4b44-8235-93fc6ed15967 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:31.153976 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 591/1168] 10.222.0.23 () {54 vars in 927 bytes} [Mon Oct 24 08:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:31.160386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba388c9a-7f3c-457e-ba71-b8e66eb61559 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:31.160947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba388c9a-7f3c-457e-ba71-b8e66eb61559 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:31.160947 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba388c9a-7f3c-457e-ba71-b8e66eb61559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:31.233816 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-ba388c9a-7f3c-457e-ba71-b8e66eb61559 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:31.234962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ba388c9a-7f3c-457e-ba71-b8e66eb61559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:31.354441 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 578/1169] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:31.656064 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65698506-5ef7-4b44-8235-93fc6ed15967 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:31.657674 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-65698506-5ef7-4b44-8235-93fc6ed15967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:31.776240 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65698506-5ef7-4b44-8235-93fc6ed15967 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:31.861122 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48a4ff-5a11-448c-bd8b-d95dbfbce363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:31.861801 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a4ff-5a11-448c-bd8b-d95dbfbce363 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:31.862076 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a4ff-5a11-448c-bd8b-d95dbfbce363 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:31.862356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a4ff-5a11-448c-bd8b-d95dbfbce363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:31.864039 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-9c48a4ff-5a11-448c-bd8b-d95dbfbce363 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:31.873981 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:31.991369 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48a4ff-5a11-448c-bd8b-d95dbfbce363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:31.992820 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48a4ff-5a11-448c-bd8b-d95dbfbce363 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:32.013027 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 592/1170] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:41.352529 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=82 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:42.010702 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=50 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:48.943375 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0522a4-e511-47f9-add7-0d33f6eb27aa None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:48.943996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0522a4-e511-47f9-add7-0d33f6eb27aa None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:48.943996 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0522a4-e511-47f9-add7-0d33f6eb27aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:49.035988 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-7f0522a4-e511-47f9-add7-0d33f6eb27aa None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:49.037199 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-7f0522a4-e511-47f9-add7-0d33f6eb27aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:49.147942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 579/1171] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:49.155814 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781f1c-d772-43c7-9dc8-5905297c54d0 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:49.156386 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781f1c-d772-43c7-9dc8-5905297c54d0 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:49.156386 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf781f1c-d772-43c7-9dc8-5905297c54d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:49.237848 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-bf781f1c-d772-43c7-9dc8-5905297c54d0 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:49.238956 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-bf781f1c-d772-43c7-9dc8-5905297c54d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:49.351191 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 593/1172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:49.355927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0522a4-e511-47f9-add7-0d33f6eb27aa None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:49.357168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-7f0522a4-e511-47f9-add7-0d33f6eb27aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:49.369857 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0522a4-e511-47f9-add7-0d33f6eb27aa None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:49.438787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:49.475068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:49.475668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:49.475939 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:49.476200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:49.476830 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:44:49.477122 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:49.478157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING py.warnings [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:44:49.478157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: warnings.warn(msg) Oct 24 08:44:49.478157 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: Oct 24 08:44:49.479032 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:49.491756 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 580/1173] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 24 08:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:44:49.501412 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf781f1c-d772-43c7-9dc8-5905297c54d0 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:49.510633 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf781f1c-d772-43c7-9dc8-5905297c54d0 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:49.572341 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:49.606629 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:49.607233 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:49.607505 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:49.607768 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:49.608395 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:49.609516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING py.warnings [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:44:49.609516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: warnings.warn(msg) Oct 24 08:44:49.609516 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: Oct 24 08:44:49.610697 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:49.668579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 594/1174] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 24 08:44:49 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:44:49.672210 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:49.674798 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:49.708200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd2b38-540c-4677-86be-f39b45615e0f admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:49.801382 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:49.802006 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:49.802276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:49.802537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:49.803164 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:49.804163 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING py.warnings [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:44:49.804163 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: warnings.warn(msg) Oct 24 08:44:49.804163 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: Oct 24 08:44:49.805355 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:49.851820 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 581/1175] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:44:49 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:44:49.853123 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:49.854751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:49.916970 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64d161-bd12-4bb4-a961-021f20935cca admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:50.005278 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:50.015956 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:50.016568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:50.016843 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:50.017112 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:50.018457 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:50.020043 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:50.032554 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 595/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:44:50.037387 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:50.038922 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:50.050148 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47de0d7-0073-40c3-98c0-b08ffc3cf4a7 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:50.075752 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:50.152854 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310863fa-dc21-4191-8cb2-52be99d98b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:50.153481 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310863fa-dc21-4191-8cb2-52be99d98b63 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:50.153762 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310863fa-dc21-4191-8cb2-52be99d98b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:50.154028 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310863fa-dc21-4191-8cb2-52be99d98b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:50.154664 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310863fa-dc21-4191-8cb2-52be99d98b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:50.156248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310863fa-dc21-4191-8cb2-52be99d98b63 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:50.168936 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 582/1177] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:44:50.173147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:50.174696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:50.208642 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8547-874c-4de0-95db-8dded8c0b03d admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:50.304336 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac414245-8200-4c02-ba38-7e3d2fec4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:50.304984 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414245-8200-4c02-ba38-7e3d2fec4daf admin admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:50.305256 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414245-8200-4c02-ba38-7e3d2fec4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:50.305547 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414245-8200-4c02-ba38-7e3d2fec4daf admin admin] PATH_INFO: `/v3/projects/2cd47b6fc14c4011a127a6d2145015a4/users/0ab6fc71a06a49419e71386f61c961a3/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:50.329490 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac414245-8200-4c02-ba38-7e3d2fec4daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd47b6fc14c4011a127a6d2145015a4, user_id=0ab6fc71a06a49419e71386f61c961a3, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:50.332759 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac414245-8200-4c02-ba38-7e3d2fec4daf admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:50.358479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 596/1178] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 24 08:44:50 2022] PUT /identity/v3/projects/2cd47b6fc14c4011a127a6d2145015a4/users/0ab6fc71a06a49419e71386f61c961a3/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:44:50.369743 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ec23-e6f2-4bf1-9a2a-9f10c18e5f03 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:50.370024 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ec23-e6f2-4bf1-9a2a-9f10c18e5f03 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:50.370290 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ec23-e6f2-4bf1-9a2a-9f10c18e5f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:50.429855 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-4db0ec23-e6f2-4bf1-9a2a-9f10c18e5f03 None None] MFA Rules not processed for user `0ab6fc71a06a49419e71386f61c961a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:50.431054 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-4db0ec23-e6f2-4bf1-9a2a-9f10c18e5f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:50.510742 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 583/1179] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:44:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:50.524666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4fc97-0418-4420-9429-6f0995e84745 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:50.525034 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4fc97-0418-4420-9429-6f0995e84745 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:50.525312 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4fc97-0418-4420-9429-6f0995e84745 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:50.526698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 597/1180] 10.222.0.23 () {54 vars in 963 bytes} [Mon Oct 24 08:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:44:50.531740 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842b3a-20b6-48d1-bd4c-7fa19f4a313e None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:50.532019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842b3a-20b6-48d1-bd4c-7fa19f4a313e None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:50.532288 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842b3a-20b6-48d1-bd4c-7fa19f4a313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:50.566299 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:50.612258 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-ac842b3a-20b6-48d1-bd4c-7fa19f4a313e None None] MFA Rules not processed for user `f1e86459f94d403bbec3b2f4dc56c458`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:50.613369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ac842b3a-20b6-48d1-bd4c-7fa19f4a313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:50.687833 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 584/1181] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Oct 24 08:44:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:50.698056 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4fc97-0418-4420-9429-6f0995e84745 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:50.699902 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-9ec4fc97-0418-4420-9429-6f0995e84745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:50.752825 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:50.806678 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4fc97-0418-4420-9429-6f0995e84745 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:50.883187 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e86459f94d403bbec3b2f4dc56c458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:50.883701 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:50.883973 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:50.884244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:50.885853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:50.993362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:50.994927 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:50.998738 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:51.014563 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 598/1182] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:44:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:44:51.061192 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e08a-901d-4ae6-8221-4d814ac95f36 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:51.061643 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e08a-901d-4ae6-8221-4d814ac95f36 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:51.061763 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e08a-901d-4ae6-8221-4d814ac95f36 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:51.063043 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 585/1183] 10.222.0.23 () {52 vars in 830 bytes} [Mon Oct 24 08:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:44:51.067722 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:51.068922 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:51.172928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35014a8a-0866-47f0-96d9-34278e36d808 service cinder] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:51.270637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:51.271964 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:51.272637 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:51.272901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] PATH_INFO: `/v3/users/0ab6fc71a06a49419e71386f61c961a3` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:51.287276 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab6fc71a06a49419e71386f61c961a3)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:51.288323 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING py.warnings [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:44:51.288323 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: warnings.warn(msg) Oct 24 08:44:51.288323 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: Oct 24 08:44:51.289585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:51.302489 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=100 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:51.363881 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab6fc71a06a49419e71386f61c961a3'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:51.364526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab6fc71a06a49419e71386f61c961a3'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:51.388453 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab6fc71a06a49419e71386f61c961a3'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:51.402932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab6fc71a06a49419e71386f61c961a3'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:51.403423 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab6fc71a06a49419e71386f61c961a3'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:51.424532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 599/1184] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 24 08:44:51 2022] DELETE /identity/v3/users/0ab6fc71a06a49419e71386f61c961a3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:44:51.428919 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0883f2-aceb-42f0-9763-0f7aabd32f84 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:51.429222 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0883f2-aceb-42f0-9763-0f7aabd32f84 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:51.429516 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0883f2-aceb-42f0-9763-0f7aabd32f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:51.490668 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-db0883f2-aceb-42f0-9763-0f7aabd32f84 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:51.491888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-db0883f2-aceb-42f0-9763-0f7aabd32f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:51.568962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:51.583772 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 586/1185] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:51.593547 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:51.594774 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:51.698925 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05025137-b854-47fa-8cb1-c52824a40937 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:51.754356 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:51.774183 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee68c3d-5d22-4961-8ef8-ab31fde788d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:51.774793 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68c3d-5d22-4961-8ef8-ab31fde788d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:51.775069 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68c3d-5d22-4961-8ef8-ab31fde788d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:51.775377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68c3d-5d22-4961-8ef8-ab31fde788d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:51.776934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-fee68c3d-5d22-4961-8ef8-ab31fde788d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:51.888149 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee68c3d-5d22-4961-8ef8-ab31fde788d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:51.889618 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee68c3d-5d22-4961-8ef8-ab31fde788d8 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:51.910459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 600/1186] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:44:52.284779 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0883f2-aceb-42f0-9763-0f7aabd32f84 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:52.286044 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-db0883f2-aceb-42f0-9763-0f7aabd32f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:52.297783 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0883f2-aceb-42f0-9763-0f7aabd32f84 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:52.403191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:52.403840 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:52.404119 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:52.404392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] PATH_INFO: `/v3/projects/2cd47b6fc14c4011a127a6d2145015a4` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:52.415291 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd47b6fc14c4011a127a6d2145015a4)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:52.416320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING py.warnings [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:44:52.416320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: warnings.warn(msg) Oct 24 08:44:52.416320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: Oct 24 08:44:52.417560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:52.479330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd47b6fc14c4011a127a6d2145015a4', 'request_id': 'req-2ec5a2f3-568a-4916-a706-eb2dd95d1888'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:52.488226 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd47b6fc14c4011a127a6d2145015a4', 'request_id': 'req-2ec5a2f3-568a-4916-a706-eb2dd95d1888'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:52.498630 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd47b6fc14c4011a127a6d2145015a4', 'request_id': 'req-2ec5a2f3-568a-4916-a706-eb2dd95d1888'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:52.529972 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] The token cache is being invalidate because project 2cd47b6fc14c4011a127a6d2145015a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:44:52.530167 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:52.530726 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-2ec5a2f3-568a-4916-a706-eb2dd95d1888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:44:52.532080 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 587/1187] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 24 08:44:52 2022] DELETE /identity/v3/projects/2cd47b6fc14c4011a127a6d2145015a4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:45:01.907242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=62 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:02.527804 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:46:08.898251 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0223-e32a-463d-b62c-14eb63c7461a None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:08.898878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0223-e32a-463d-b62c-14eb63c7461a None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:08.898878 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0223-e32a-463d-b62c-14eb63c7461a None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:08.900124 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 601/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:08.905596 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b08b4-d0cb-4b6a-bbc0-fc12a10f5eb4 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:08.906067 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b08b4-d0cb-4b6a-bbc0-fc12a10f5eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:08.906801 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b08b4-d0cb-4b6a-bbc0-fc12a10f5eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:08.995322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-614b08b4-d0cb-4b6a-bbc0-fc12a10f5eb4 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:08.996536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-614b08b4-d0cb-4b6a-bbc0-fc12a10f5eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:09.104094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 588/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:09.264432 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b0223-e32a-463d-b62c-14eb63c7461a None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:09.266685 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-db2b0223-e32a-463d-b62c-14eb63c7461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:09.384352 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b0223-e32a-463d-b62c-14eb63c7461a None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:09.389755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99425c76-9df9-4898-b160-3d00891cf415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:09.390357 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425c76-9df9-4898-b160-3d00891cf415 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:09.390674 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425c76-9df9-4898-b160-3d00891cf415 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:09.391059 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425c76-9df9-4898-b160-3d00891cf415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:09.399269 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99425c76-9df9-4898-b160-3d00891cf415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:09.400853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99425c76-9df9-4898-b160-3d00891cf415 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:09.410614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 602/1190] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:46:10.491118 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa10cec-d221-4b7d-a442-8207a15da060 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:10.496959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa10cec-d221-4b7d-a442-8207a15da060 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:10.496959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa10cec-d221-4b7d-a442-8207a15da060 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:10.496959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 589/1191] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:10.499432 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d467aa-48c8-4a18-a478-3728fda7b9db None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:10.500409 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d467aa-48c8-4a18-a478-3728fda7b9db None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:10.500638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d467aa-48c8-4a18-a478-3728fda7b9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:10.520930 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-f7d467aa-48c8-4a18-a478-3728fda7b9db None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:10.522186 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f7d467aa-48c8-4a18-a478-3728fda7b9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:10.529969 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 603/1192] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:10.682921 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa10cec-d221-4b7d-a442-8207a15da060 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:10.697494 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa10cec-d221-4b7d-a442-8207a15da060 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:10.703552 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b3a26-be9e-4e8c-b7a7-944d061a2364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:10.704176 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3a26-be9e-4e8c-b7a7-944d061a2364 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:10.704450 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3a26-be9e-4e8c-b7a7-944d061a2364 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:10.704717 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3a26-be9e-4e8c-b7a7-944d061a2364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:10.712721 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b3a26-be9e-4e8c-b7a7-944d061a2364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:10.714332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b3a26-be9e-4e8c-b7a7-944d061a2364 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:10.723729 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 590/1193] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:46:13.196908 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ea71-b05c-4350-9129-d803c8f577ed None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:13.197499 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ea71-b05c-4350-9129-d803c8f577ed None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:13.197612 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ea71-b05c-4350-9129-d803c8f577ed None None] PATH_INFO: `/v3` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:13.198816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 604/1194] 10.222.0.46 () {54 vars in 925 bytes} [Mon Oct 24 08:46:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:46:13.205880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633b7ed-47e0-4dee-8550-4d5bf589e018 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:13.206342 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633b7ed-47e0-4dee-8550-4d5bf589e018 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:13.206455 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633b7ed-47e0-4dee-8550-4d5bf589e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:13.268969 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-b633b7ed-47e0-4dee-8550-4d5bf589e018 None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:13.270212 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-b633b7ed-47e0-4dee-8550-4d5bf589e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:13.287240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:46:13.342360 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 591/1195] 10.222.0.46 () {58 vars in 1015 bytes} [Mon Oct 24 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:16.947971 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b3ad-af89-4dae-a75f-e1b025aef0e6 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:16.948511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b3ad-af89-4dae-a75f-e1b025aef0e6 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:16.948511 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47b3ad-af89-4dae-a75f-e1b025aef0e6 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:16.949908 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 605/1196] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 24 08:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:16.955466 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba845f-38a1-4ad2-8b28-294c9b0fc93e None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:16.956143 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba845f-38a1-4ad2-8b28-294c9b0fc93e None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:16.956143 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba845f-38a1-4ad2-8b28-294c9b0fc93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:16.977008 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-e7ba845f-38a1-4ad2-8b28-294c9b0fc93e None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:16.978314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-e7ba845f-38a1-4ad2-8b28-294c9b0fc93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:16.987149 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 592/1197] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 24 08:46:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:16.995011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b3ad-af89-4dae-a75f-e1b025aef0e6 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:17.009128 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47b3ad-af89-4dae-a75f-e1b025aef0e6 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:17.014096 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b606672-e1b4-473b-b820-867af36c809a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd207dc4d9105430cb337641d736b318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:17.014757 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b606672-e1b4-473b-b820-867af36c809a service placement] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:17.015032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b606672-e1b4-473b-b820-867af36c809a service placement] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:17.015823 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b606672-e1b4-473b-b820-867af36c809a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:17.025139 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b606672-e1b4-473b-b820-867af36c809a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:17.026793 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b606672-e1b4-473b-b820-867af36c809a service placement] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:17.038425 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 606/1198] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:46:22.210714 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288dad3-051e-47cf-8f69-16649ae2f0aa None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:22.211259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288dad3-051e-47cf-8f69-16649ae2f0aa None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:22.211259 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288dad3-051e-47cf-8f69-16649ae2f0aa None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:22.212586 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 593/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:22.217713 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e1e4-a820-4dd2-a7be-eef372a2f5f5 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:22.218144 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e1e4-a820-4dd2-a7be-eef372a2f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:22.218489 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e1e4-a820-4dd2-a7be-eef372a2f5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:22.243316 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-e5f7e1e4-a820-4dd2-a7be-eef372a2f5f5 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:22.244547 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e5f7e1e4-a820-4dd2-a7be-eef372a2f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:22.253608 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 607/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:22.414499 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288dad3-051e-47cf-8f69-16649ae2f0aa None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:22.429377 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288dad3-051e-47cf-8f69-16649ae2f0aa None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:22.434737 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef7322-3e4a-461e-bdba-eebd5b18fe94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:22.435327 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7322-3e4a-461e-bdba-eebd5b18fe94 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:22.435595 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7322-3e4a-461e-bdba-eebd5b18fe94 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:22.435863 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7322-3e4a-461e-bdba-eebd5b18fe94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:22.445029 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef7322-3e4a-461e-bdba-eebd5b18fe94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:22.446649 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef7322-3e4a-461e-bdba-eebd5b18fe94 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:22.459584 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 594/1201] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:46:23.541624 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251edfe0-1f5e-4ea9-b531-23a891d39a61 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:23.542210 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251edfe0-1f5e-4ea9-b531-23a891d39a61 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:23.542313 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251edfe0-1f5e-4ea9-b531-23a891d39a61 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:23.543695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 608/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:23.549284 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee45e0-7229-44ea-bb34-85ebb96d1808 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:23.549900 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee45e0-7229-44ea-bb34-85ebb96d1808 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:23.549900 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee45e0-7229-44ea-bb34-85ebb96d1808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:23.570863 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-b2ee45e0-7229-44ea-bb34-85ebb96d1808 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:23.572088 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-b2ee45e0-7229-44ea-bb34-85ebb96d1808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:23.581509 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 595/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:23.736416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251edfe0-1f5e-4ea9-b531-23a891d39a61 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:23.752258 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251edfe0-1f5e-4ea9-b531-23a891d39a61 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:23.758120 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0089b4-475b-4db9-994a-247b9fb310f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:23.758710 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0089b4-475b-4db9-994a-247b9fb310f3 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:23.758981 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0089b4-475b-4db9-994a-247b9fb310f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:23.759246 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0089b4-475b-4db9-994a-247b9fb310f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:23.769783 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0089b4-475b-4db9-994a-247b9fb310f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:23.771362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0089b4-475b-4db9-994a-247b9fb310f3 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:23.781614 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 609/1204] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:46:27.828360 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa13b6-ea3d-48d6-8cba-2a29d160e68d None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:27.828908 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa13b6-ea3d-48d6-8cba-2a29d160e68d None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:27.828908 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa13b6-ea3d-48d6-8cba-2a29d160e68d None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:27.830560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 596/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:27.837240 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791af3-bbf8-436b-bedc-322af0a05f48 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:27.837776 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791af3-bbf8-436b-bedc-322af0a05f48 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:27.837885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791af3-bbf8-436b-bedc-322af0a05f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:27.859708 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-b1791af3-bbf8-436b-bedc-322af0a05f48 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:27.860910 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-b1791af3-bbf8-436b-bedc-322af0a05f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:27.868662 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 610/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:28.158527 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa13b6-ea3d-48d6-8cba-2a29d160e68d None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:28.160498 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-40aa13b6-ea3d-48d6-8cba-2a29d160e68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:28.248512 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa13b6-ea3d-48d6-8cba-2a29d160e68d None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:28.253416 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319112-165a-41a7-8f3a-6601b2e9faf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:28.254035 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319112-165a-41a7-8f3a-6601b2e9faf4 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:28.254306 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319112-165a-41a7-8f3a-6601b2e9faf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:28.254570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319112-165a-41a7-8f3a-6601b2e9faf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:28.263605 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319112-165a-41a7-8f3a-6601b2e9faf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:28.265373 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319112-165a-41a7-8f3a-6601b2e9faf4 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:28.275322 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 597/1207] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:46:30.565408 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181334e7-c3ab-4f39-827d-7d516498686e None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:30.566006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181334e7-c3ab-4f39-827d-7d516498686e None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:30.566006 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181334e7-c3ab-4f39-827d-7d516498686e None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:30.567303 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 611/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:30.572610 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0447e-0ec3-4309-bf44-7a7b52de7fed None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:30.573083 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0447e-0ec3-4309-bf44-7a7b52de7fed None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:30.573191 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0447e-0ec3-4309-bf44-7a7b52de7fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:30.597727 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-8de0447e-0ec3-4309-bf44-7a7b52de7fed None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:30.599017 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-8de0447e-0ec3-4309-bf44-7a7b52de7fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:30.606979 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 598/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:30.897610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181334e7-c3ab-4f39-827d-7d516498686e None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:30.899351 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-181334e7-c3ab-4f39-827d-7d516498686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:30.916290 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181334e7-c3ab-4f39-827d-7d516498686e None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:30.919939 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35742a6b-30cd-449a-9f81-f5db00e887fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:30.920538 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742a6b-30cd-449a-9f81-f5db00e887fe service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:30.920813 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742a6b-30cd-449a-9f81-f5db00e887fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:30.921083 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742a6b-30cd-449a-9f81-f5db00e887fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:30.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35742a6b-30cd-449a-9f81-f5db00e887fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:30.933121 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35742a6b-30cd-449a-9f81-f5db00e887fe service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:30.942918 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 612/1210] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:46:34.749061 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2743-4dfb-4ea1-8534-8ba9cb173274 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:34.750314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2743-4dfb-4ea1-8534-8ba9cb173274 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:34.750314 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2743-4dfb-4ea1-8534-8ba9cb173274 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:34.751029 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 599/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:34.757200 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df7c6-2e6e-45a3-9ddc-ae2fb3f3c383 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:34.757775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df7c6-2e6e-45a3-9ddc-ae2fb3f3c383 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:34.757775 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389df7c6-2e6e-45a3-9ddc-ae2fb3f3c383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:34.765385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=81 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:46:34.778667 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-389df7c6-2e6e-45a3-9ddc-ae2fb3f3c383 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:34.779876 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-389df7c6-2e6e-45a3-9ddc-ae2fb3f3c383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:34.787953 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 613/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:35.111218 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a2743-4dfb-4ea1-8534-8ba9cb173274 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:35.113066 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-1a5a2743-4dfb-4ea1-8534-8ba9cb173274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:35.185372 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:46:35.203424 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a2743-4dfb-4ea1-8534-8ba9cb173274 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:35.207226 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace602e-bf3e-4528-89ce-37018ac8ada0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e86459f94d403bbec3b2f4dc56c458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:35.207836 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace602e-bf3e-4528-89ce-37018ac8ada0 service cinder] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:35.208114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace602e-bf3e-4528-89ce-37018ac8ada0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:35.208385 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace602e-bf3e-4528-89ce-37018ac8ada0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:35.217773 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace602e-bf3e-4528-89ce-37018ac8ada0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:35.219392 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace602e-bf3e-4528-89ce-37018ac8ada0 service cinder] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:35.229399 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 600/1213] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:46:37.477427 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39ea3-f47c-462a-aeba-3281ee625564 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:37.477872 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39ea3-f47c-462a-aeba-3281ee625564 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:37.478018 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39ea3-f47c-462a-aeba-3281ee625564 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:37.479401 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 614/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:46:37.485561 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472cd1-07f1-4ff7-92e4-d1b4a712ef20 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:37.486100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472cd1-07f1-4ff7-92e4-d1b4a712ef20 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:37.486100 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472cd1-07f1-4ff7-92e4-d1b4a712ef20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:37.507779 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-33472cd1-07f1-4ff7-92e4-d1b4a712ef20 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:46:37.508970 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-33472cd1-07f1-4ff7-92e4-d1b4a712ef20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:37.517137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 601/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:46:37.850237 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa39ea3-f47c-462a-aeba-3281ee625564 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:46:37.852032 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-7fa39ea3-f47c-462a-aeba-3281ee625564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:46:37.865665 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa39ea3-f47c-462a-aeba-3281ee625564 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:46:37.869179 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd545c0-691b-4446-b323-63a40a6b3db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1e86459f94d403bbec3b2f4dc56c458', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:46:37.869807 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd545c0-691b-4446-b323-63a40a6b3db3 service cinder] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:46:37.870079 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd545c0-691b-4446-b323-63a40a6b3db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:46:37.870346 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd545c0-691b-4446-b323-63a40a6b3db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:46:37.880269 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd545c0-691b-4446-b323-63a40a6b3db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:46:37.881844 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd545c0-691b-4446-b323-63a40a6b3db3 service cinder] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:46:37.892958 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 615/1216] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:46:47.502764 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=11 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:46:47.887635 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=8 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:56.872185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67021-63be-4e58-80d1-f7966902aa64 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:56.873327 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67021-63be-4e58-80d1-f7966902aa64 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:56.873927 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67021-63be-4e58-80d1-f7966902aa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:56.874743 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e3b67-afc4-43c8-8041-2c96b4d2b583 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:56.875179 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e3b67-afc4-43c8-8041-2c96b4d2b583 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:56.875327 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e3b67-afc4-43c8-8041-2c96b4d2b583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:56.894493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-8ad67021-63be-4e58-80d1-f7966902aa64 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:47:56.894833 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-861e3b67-afc4-43c8-8041-2c96b4d2b583 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:47:56.895697 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-8ad67021-63be-4e58-80d1-f7966902aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:47:56.896005 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-861e3b67-afc4-43c8-8041-2c96b4d2b583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:47:56.903384 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 602/1217] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:47:56.905135 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 616/1218] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:47:56.913675 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874980fb-88f3-466f-986d-bfd10a8e703b None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:56.913956 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874980fb-88f3-466f-986d-bfd10a8e703b None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:56.914234 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874980fb-88f3-466f-986d-bfd10a8e703b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:56.916327 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010849a-21c1-4e0a-83c7-bee6cab1262f None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:56.916610 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010849a-21c1-4e0a-83c7-bee6cab1262f None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:56.916910 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010849a-21c1-4e0a-83c7-bee6cab1262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:56.936128 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-874980fb-88f3-466f-986d-bfd10a8e703b None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:47:56.937192 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-b010849a-21c1-4e0a-83c7-bee6cab1262f None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:47:56.937320 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-874980fb-88f3-466f-986d-bfd10a8e703b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:47:56.938390 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-b010849a-21c1-4e0a-83c7-bee6cab1262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:47:56.945136 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 603/1219] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:47:56.946363 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 617/1220] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:47:56.949656 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874980fb-88f3-466f-986d-bfd10a8e703b None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:56.951051 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010849a-21c1-4e0a-83c7-bee6cab1262f None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:56.958813 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874980fb-88f3-466f-986d-bfd10a8e703b None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:56.960300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010849a-21c1-4e0a-83c7-bee6cab1262f None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:56.963470 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:56.964129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:56.964406 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:56.964679 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] PATH_INFO: `/v3/domains` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:56.965119 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:56.965456 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:47:56.965770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:56.966928 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:56.967271 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:56.967551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] PATH_INFO: `/v3/domains` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:56.968179 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:47:56.968298 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:56.968478 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:56.969501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING py.warnings [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:47:56.969501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: warnings.warn(msg) Oct 24 08:47:56.969501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: Oct 24 08:47:56.970377 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:56.989542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 618/1221] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 24 08:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:47:56.989749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 604/1222] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Oct 24 08:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:47:56.991140 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:56.991294 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.001698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc6b57-4b34-44b2-97f2-0617e8957e6e admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.002068 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719e9d5-2a07-4ef6-9102-85e7fc22a7ae admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.006560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.006752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265a3c2-ddc2-4a0b-a630-ae09f612c7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.007159 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.007361 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265a3c2-ddc2-4a0b-a630-ae09f612c7db admin admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.007473 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.007636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265a3c2-ddc2-4a0b-a630-ae09f612c7db admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.007749 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.007903 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265a3c2-ddc2-4a0b-a630-ae09f612c7db admin admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.008292 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.008540 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265a3c2-ddc2-4a0b-a630-ae09f612c7db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.009304 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: WARNING py.warnings [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:47:57.009304 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: warnings.warn(msg) Oct 24 08:47:57.009304 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: Oct 24 08:47:57.010560 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.010863 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265a3c2-ddc2-4a0b-a630-ae09f612c7db admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.050207 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 619/1223] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 24 08:47:56 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:47:57.053476 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 605/1224] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 24 08:47:56 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:47:57.055439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265a3c2-ddc2-4a0b-a630-ae09f612c7db admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.055585 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.117880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1b0f0-66e0-46e7-a347-76a718fd4f3b admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.118243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265a3c2-ddc2-4a0b-a630-ae09f612c7db admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5430bb-8b72-43f5-8d0b-4a2be2d3f1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.124389 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5430bb-8b72-43f5-8d0b-4a2be2d3f1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.124558 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.124678 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5430bb-8b72-43f5-8d0b-4a2be2d3f1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.124924 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5430bb-8b72-43f5-8d0b-4a2be2d3f1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.125166 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.125465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.125579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5430bb-8b72-43f5-8d0b-4a2be2d3f1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.125737 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.126364 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.127366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: WARNING py.warnings [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:47:57.127366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: warnings.warn(msg) Oct 24 08:47:57.127366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: Oct 24 08:47:57.127630 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5430bb-8b72-43f5-8d0b-4a2be2d3f1d9 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.128579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.150330 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 606/1225] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:47:57 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:47:57.150845 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 620/1226] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:47:57 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:47:57.155091 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5430bb-8b72-43f5-8d0b-4a2be2d3f1d9 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.155366 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.165129 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5430bb-8b72-43f5-8d0b-4a2be2d3f1d9 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.165477 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15f6fb-c9cc-4d31-aa6b-3887ecd7613d admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.170360 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5eecb-997e-4f0c-a3bd-7b9165606be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.170960 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5eecb-997e-4f0c-a3bd-7b9165606be4 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.171237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5eecb-997e-4f0c-a3bd-7b9165606be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.171342 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b19782-12da-497b-be0b-7281923260d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.171506 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5eecb-997e-4f0c-a3bd-7b9165606be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.171880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19782-12da-497b-be0b-7281923260d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.172144 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5eecb-997e-4f0c-a3bd-7b9165606be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.172248 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19782-12da-497b-be0b-7281923260d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.172418 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19782-12da-497b-be0b-7281923260d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.173081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b19782-12da-497b-be0b-7281923260d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.173769 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5eecb-997e-4f0c-a3bd-7b9165606be4 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.174688 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b19782-12da-497b-be0b-7281923260d5 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.184114 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 607/1227] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:47:57.185472 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 621/1228] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:47:57.188263 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5eecb-997e-4f0c-a3bd-7b9165606be4 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.188769 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b19782-12da-497b-be0b-7281923260d5 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.198350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b19782-12da-497b-be0b-7281923260d5 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.198540 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5eecb-997e-4f0c-a3bd-7b9165606be4 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.203656 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63219-94d2-4b29-a848-c64bcf759b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.203850 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd33b8-450c-4f62-8890-0810b7a49778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.204262 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63219-94d2-4b29-a848-c64bcf759b45 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.204396 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd33b8-450c-4f62-8890-0810b7a49778 admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.204539 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63219-94d2-4b29-a848-c64bcf759b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.204646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd33b8-450c-4f62-8890-0810b7a49778 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.204812 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63219-94d2-4b29-a848-c64bcf759b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.204919 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd33b8-450c-4f62-8890-0810b7a49778 admin admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.205459 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f63219-94d2-4b29-a848-c64bcf759b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.205589 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd33b8-450c-4f62-8890-0810b7a49778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.207052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f63219-94d2-4b29-a848-c64bcf759b45 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.207180 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd33b8-450c-4f62-8890-0810b7a49778 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.218399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 622/1229] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:47:57.221757 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 608/1230] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:47:57.223188 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63219-94d2-4b29-a848-c64bcf759b45 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.223316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd33b8-450c-4f62-8890-0810b7a49778 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.233516 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd33b8-450c-4f62-8890-0810b7a49778 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.234350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63219-94d2-4b29-a848-c64bcf759b45 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.238272 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6a28d-e4df-4dab-bb1b-bf6122b45cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.238946 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6a28d-e4df-4dab-bb1b-bf6122b45cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.239244 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6a7b0-7cd7-4db5-b437-5be28bef51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.239362 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6a28d-e4df-4dab-bb1b-bf6122b45cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.239510 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6a28d-e4df-4dab-bb1b-bf6122b45cbb admin admin] PATH_INFO: `/v3/projects/5dc65275ea574b7fbf96a5a9210facac/users/140ef0ddf6a54c72a2b67953fae03b26/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.239897 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6a7b0-7cd7-4db5-b437-5be28bef51ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.240169 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6a7b0-7cd7-4db5-b437-5be28bef51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.240436 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6a7b0-7cd7-4db5-b437-5be28bef51ff admin admin] PATH_INFO: `/v3/projects/0433756c9da14c448c57fc8b910b28f3/users/8c5371ed06de4936a51805b8feab3613/roles/b03c99b693c24e2c91857f8ca6255e56` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.255463 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6a28d-e4df-4dab-bb1b-bf6122b45cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc65275ea574b7fbf96a5a9210facac, user_id=140ef0ddf6a54c72a2b67953fae03b26, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.256689 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6a7b0-7cd7-4db5-b437-5be28bef51ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0433756c9da14c448c57fc8b910b28f3, user_id=8c5371ed06de4936a51805b8feab3613, role_id=b03c99b693c24e2c91857f8ca6255e56)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.258267 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6a28d-e4df-4dab-bb1b-bf6122b45cbb admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.265832 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6a7b0-7cd7-4db5-b437-5be28bef51ff admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.273558 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 609/1231] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 24 08:47:57 2022] PUT /identity/v3/projects/5dc65275ea574b7fbf96a5a9210facac/users/140ef0ddf6a54c72a2b67953fae03b26/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:47:57.280168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2e4f-44db-4d98-9046-93789cdb1279 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.280451 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2e4f-44db-4d98-9046-93789cdb1279 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.280720 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb2e4f-44db-4d98-9046-93789cdb1279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.282101 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 623/1232] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 24 08:47:57 2022] PUT /identity/v3/projects/0433756c9da14c448c57fc8b910b28f3/users/8c5371ed06de4936a51805b8feab3613/roles/b03c99b693c24e2c91857f8ca6255e56 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:47:57.286963 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310607b3-5981-4ee3-a953-1cb4c9ae9632 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.287250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310607b3-5981-4ee3-a953-1cb4c9ae9632 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.287527 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310607b3-5981-4ee3-a953-1cb4c9ae9632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.301814 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-afcb2e4f-44db-4d98-9046-93789cdb1279 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:47:57.303011 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-afcb2e4f-44db-4d98-9046-93789cdb1279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:47:57.305808 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-310607b3-5981-4ee3-a953-1cb4c9ae9632 None None] MFA Rules not processed for user `eb436ff244d04b3cb3470051690a8e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:47:57.306987 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-310607b3-5981-4ee3-a953-1cb4c9ae9632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:47:57.347018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:57.350834 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:47:57.365714 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 610/1233] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:47:57.375050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 624/1234] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:47:57.376154 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2e4f-44db-4d98-9046-93789cdb1279 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.383880 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310607b3-5981-4ee3-a953-1cb4c9ae9632 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:47:57.433736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb2e4f-44db-4d98-9046-93789cdb1279 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.438131 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb4f22-aed7-4ce0-8d3f-54154da0624d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.438739 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4f22-aed7-4ce0-8d3f-54154da0624d service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.439023 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4f22-aed7-4ce0-8d3f-54154da0624d service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.439293 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4f22-aed7-4ce0-8d3f-54154da0624d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.441012 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310607b3-5981-4ee3-a953-1cb4c9ae9632 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:47:57.444702 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c7993-8159-4501-93ca-548e0eb06b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:47:57.445432 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7993-8159-4501-93ca-548e0eb06b5f service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:47:57.445740 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7993-8159-4501-93ca-548e0eb06b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:47:57.446010 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7993-8159-4501-93ca-548e0eb06b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:47:57.448492 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb4f22-aed7-4ce0-8d3f-54154da0624d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.449957 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb4f22-aed7-4ce0-8d3f-54154da0624d service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.455175 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c7993-8159-4501-93ca-548e0eb06b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:47:57.456625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c7993-8159-4501-93ca-548e0eb06b5f service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:47:57.459803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 611/1235] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:47:57.468462 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 625/1236] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:48:03.005264 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d60b8-6d2b-4e6d-aebc-52c2c36ef4b3 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.007456 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d60b8-6d2b-4e6d-aebc-52c2c36ef4b3 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.008832 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d60b8-6d2b-4e6d-aebc-52c2c36ef4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.052845 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-274d60b8-6d2b-4e6d-aebc-52c2c36ef4b3 None None] MFA Rules not processed for user `140ef0ddf6a54c72a2b67953fae03b26`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:03.054706 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-274d60b8-6d2b-4e6d-aebc-52c2c36ef4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:03.186311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 612/1237] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:03.191532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c7993-8159-4501-93ca-548e0eb06b5f service neutron] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:03.204339 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c7993-8159-4501-93ca-548e0eb06b5f service neutron] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:03.209619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f5a67-8c11-448c-bbc6-6bfa7e4c6695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:03.210559 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5a67-8c11-448c-bbc6-6bfa7e4c6695 admin admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.210875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5a67-8c11-448c-bbc6-6bfa7e4c6695 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.211151 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5a67-8c11-448c-bbc6-6bfa7e4c6695 admin admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.211757 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f5a67-8c11-448c-bbc6-6bfa7e4c6695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:03.213711 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f5a67-8c11-448c-bbc6-6bfa7e4c6695 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:03.250280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 626/1238] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 24 08:48:03 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:48:03.255105 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d60b8-6d2b-4e6d-aebc-52c2c36ef4b3 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:03.275423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d60b8-6d2b-4e6d-aebc-52c2c36ef4b3 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:03.434415 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b794cea-f7e8-4dfd-a021-ba9dd85df15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:03.436436 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b794cea-f7e8-4dfd-a021-ba9dd85df15a admin admin] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.436646 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b794cea-f7e8-4dfd-a021-ba9dd85df15a admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.437075 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b794cea-f7e8-4dfd-a021-ba9dd85df15a admin admin] PATH_INFO: `/v3/users` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.437767 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b794cea-f7e8-4dfd-a021-ba9dd85df15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:03.439745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b794cea-f7e8-4dfd-a021-ba9dd85df15a admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:03.491707 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 613/1239] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:48:03 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:48:03.495320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f5a67-8c11-448c-bbc6-6bfa7e4c6695 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:03.526407 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f5a67-8c11-448c-bbc6-6bfa7e4c6695 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:03.543350 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2268cd3-d0f0-4033-993d-336e66b74816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:03.544875 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2268cd3-d0f0-4033-993d-336e66b74816 admin admin] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.545127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2268cd3-d0f0-4033-993d-336e66b74816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.545297 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2268cd3-d0f0-4033-993d-336e66b74816 admin admin] PATH_INFO: `/v3/roles` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.547703 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2268cd3-d0f0-4033-993d-336e66b74816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:03.549383 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2268cd3-d0f0-4033-993d-336e66b74816 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:03.589151 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 627/1240] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:48:03.593858 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b794cea-f7e8-4dfd-a021-ba9dd85df15a admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:03.604159 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b794cea-f7e8-4dfd-a021-ba9dd85df15a admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:03.617999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a265b-a557-497b-8c20-f2569d80abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:03.618689 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a265b-a557-497b-8c20-f2569d80abde admin admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.618965 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a265b-a557-497b-8c20-f2569d80abde admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.619236 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a265b-a557-497b-8c20-f2569d80abde admin admin] PATH_INFO: `/v3/projects/ea44cebc50cb4257939c99d8c328ea58/users/699326ddbb8a4b3b817e8a1eab6696bd/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.628045 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:03.642320 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6d74-ed66-4d3f-ad2a-74a3a9edd071 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.642630 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6d74-ed66-4d3f-ad2a-74a3a9edd071 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.642864 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6d74-ed66-4d3f-ad2a-74a3a9edd071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.649829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a265b-a557-497b-8c20-f2569d80abde admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea44cebc50cb4257939c99d8c328ea58, user_id=699326ddbb8a4b3b817e8a1eab6696bd, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:03.658940 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a265b-a557-497b-8c20-f2569d80abde admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:03.710380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 614/1241] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 24 08:48:03 2022] PUT /identity/v3/projects/ea44cebc50cb4257939c99d8c328ea58/users/699326ddbb8a4b3b817e8a1eab6696bd/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:48:03.714302 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a265b-a557-497b-8c20-f2569d80abde admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:03.716723 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-668e6d74-ed66-4d3f-ad2a-74a3a9edd071 None None] MFA Rules not processed for user `8c5371ed06de4936a51805b8feab3613`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:03.718041 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-668e6d74-ed66-4d3f-ad2a-74a3a9edd071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:03.834465 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 628/1242] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:48:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:03.839774 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e6d74-ed66-4d3f-ad2a-74a3a9edd071 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:03.845403 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a265b-a557-497b-8c20-f2569d80abde admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:03.851437 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9177a1a-e67d-4848-96e4-e50a346f554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:03.852552 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9177a1a-e67d-4848-96e4-e50a346f554e admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.853021 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9177a1a-e67d-4848-96e4-e50a346f554e admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.853541 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9177a1a-e67d-4848-96e4-e50a346f554e admin admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.855237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9177a1a-e67d-4848-96e4-e50a346f554e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:03.859200 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9177a1a-e67d-4848-96e4-e50a346f554e admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:03.864418 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e6d74-ed66-4d3f-ad2a-74a3a9edd071 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:03.878354 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd50d2-fc64-48cc-a7a1-93c64c4a1b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:03.879241 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd50d2-fc64-48cc-a7a1-93c64c4a1b9a admin admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.879698 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd50d2-fc64-48cc-a7a1-93c64c4a1b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.880122 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd50d2-fc64-48cc-a7a1-93c64c4a1b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.881247 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd50d2-fc64-48cc-a7a1-93c64c4a1b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:03.884331 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd50d2-fc64-48cc-a7a1-93c64c4a1b9a admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:03.885531 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 615/1243] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:48:03.886684 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9177a1a-e67d-4848-96e4-e50a346f554e admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:03.899056 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9177a1a-e67d-4848-96e4-e50a346f554e admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:03.907193 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d0ff2-cf9f-4806-b1bb-e803f145a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:03.907880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0ff2-cf9f-4806-b1bb-e803f145a8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:03.908155 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0ff2-cf9f-4806-b1bb-e803f145a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:03.908478 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0ff2-cf9f-4806-b1bb-e803f145a8fb admin admin] PATH_INFO: `/v3/projects/ea44cebc50cb4257939c99d8c328ea58/users/699326ddbb8a4b3b817e8a1eab6696bd/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:03.911731 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d0ff2-cf9f-4806-b1bb-e803f145a8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea44cebc50cb4257939c99d8c328ea58, user_id=699326ddbb8a4b3b817e8a1eab6696bd, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:03.915386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d0ff2-cf9f-4806-b1bb-e803f145a8fb admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:03.926631 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 629/1244] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Oct 24 08:48:03 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:48:03.930137 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 616/1245] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 24 08:48:03 2022] PUT /identity/v3/projects/ea44cebc50cb4257939c99d8c328ea58/users/699326ddbb8a4b3b817e8a1eab6696bd/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:48:03.934483 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd50d2-fc64-48cc-a7a1-93c64c4a1b9a admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:03.985669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:04.095934 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd50d2-fc64-48cc-a7a1-93c64c4a1b9a admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:04.109391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2ae12-8006-4257-921f-c07026df1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:04.110656 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2ae12-8006-4257-921f-c07026df1ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:04.110938 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2ae12-8006-4257-921f-c07026df1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:04.113842 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2ae12-8006-4257-921f-c07026df1ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:04.114751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2ae12-8006-4257-921f-c07026df1ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:04.119399 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2ae12-8006-4257-921f-c07026df1ac1 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:04.155436 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 630/1246] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Oct 24 08:48:03 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:48:04.159462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d0ff2-cf9f-4806-b1bb-e803f145a8fb admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:04.261428 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d0ff2-cf9f-4806-b1bb-e803f145a8fb admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:04.269414 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1a48-36ce-4e28-8d69-9e5edb40898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:04.270223 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1a48-36ce-4e28-8d69-9e5edb40898b admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:04.270451 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1a48-36ce-4e28-8d69-9e5edb40898b admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:04.270718 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1a48-36ce-4e28-8d69-9e5edb40898b admin admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:04.271500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe1a48-36ce-4e28-8d69-9e5edb40898b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:04.273131 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe1a48-36ce-4e28-8d69-9e5edb40898b admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:04.289146 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 617/1247] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:48:04.293697 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2ae12-8006-4257-921f-c07026df1ac1 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:04.313040 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2ae12-8006-4257-921f-c07026df1ac1 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:04.324988 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b141faf-939a-4d13-b1f6-b88c83096639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:04.326391 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141faf-939a-4d13-b1f6-b88c83096639 admin admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:04.327017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141faf-939a-4d13-b1f6-b88c83096639 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:04.327393 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141faf-939a-4d13-b1f6-b88c83096639 admin admin] PATH_INFO: `/v3/projects/2a61c70ffd484af9904d667cb26df619/users/1b611fb0a3264773a629b80f23fb974c/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:04.345865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b141faf-939a-4d13-b1f6-b88c83096639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a61c70ffd484af9904d667cb26df619, user_id=1b611fb0a3264773a629b80f23fb974c, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:04.349385 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b141faf-939a-4d13-b1f6-b88c83096639 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:04.374699 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 631/1248] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 24 08:48:04 2022] PUT /identity/v3/projects/2a61c70ffd484af9904d667cb26df619/users/1b611fb0a3264773a629b80f23fb974c/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:48:04.379931 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1a48-36ce-4e28-8d69-9e5edb40898b admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:04.396899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1a48-36ce-4e28-8d69-9e5edb40898b admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:04.539663 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60965c7e-8c49-4f9d-a563-affa04d594ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:04.541040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60965c7e-8c49-4f9d-a563-affa04d594ef admin admin] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:04.541328 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60965c7e-8c49-4f9d-a563-affa04d594ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:04.541722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60965c7e-8c49-4f9d-a563-affa04d594ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:04.542387 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60965c7e-8c49-4f9d-a563-affa04d594ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:04.545825 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60965c7e-8c49-4f9d-a563-affa04d594ef admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:04.555024 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:04.573258 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 618/1249] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 24 08:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:48:04.574913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b141faf-939a-4d13-b1f6-b88c83096639 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:04.591334 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b141faf-939a-4d13-b1f6-b88c83096639 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:04.607238 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:04.607932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:04.608269 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:04.608542 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] PATH_INFO: `/v3/projects/2a61c70ffd484af9904d667cb26df619/users/1b611fb0a3264773a629b80f23fb974c/roles/ebf9799815574909aa1c88e93e213c96` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:04.610695 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a61c70ffd484af9904d667cb26df619, user_id=1b611fb0a3264773a629b80f23fb974c, role_id=ebf9799815574909aa1c88e93e213c96)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:04.613413 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:04.635107 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 632/1250] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Oct 24 08:48:04 2022] PUT /identity/v3/projects/2a61c70ffd484af9904d667cb26df619/users/1b611fb0a3264773a629b80f23fb974c/roles/ebf9799815574909aa1c88e93e213c96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:48:11.837603 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785ece3-3e27-4246-a34e-9cc1227e56cc None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:11.838109 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785ece3-3e27-4246-a34e-9cc1227e56cc None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:11.838194 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785ece3-3e27-4246-a34e-9cc1227e56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:11.872807 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-a785ece3-3e27-4246-a34e-9cc1227e56cc None None] MFA Rules not processed for user `699326ddbb8a4b3b817e8a1eab6696bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:11.874896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a785ece3-3e27-4246-a34e-9cc1227e56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:11.979776 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 619/1251] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:48:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:11.997335 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:12.000172 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:12.117352 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b4eb4-889b-498c-9617-ff476b8f2d0b admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:12.121549 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619764-74dc-4165-950f-2ce969f7a4b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5dfb8c97854d37b07ef8474a54e483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:12.123180 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619764-74dc-4165-950f-2ce969f7a4b3 service glance] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:12.123646 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619764-74dc-4165-950f-2ce969f7a4b3 service glance] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:12.124332 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619764-74dc-4165-950f-2ce969f7a4b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:12.205829 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09619764-74dc-4165-950f-2ce969f7a4b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:12.207886 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09619764-74dc-4165-950f-2ce969f7a4b3 service glance] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:12.229717 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 633/1252] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:48:12.510018 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b9c05-9a46-438d-b084-bd877522e74a None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:12.510308 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b9c05-9a46-438d-b084-bd877522e74a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:12.510591 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b9c05-9a46-438d-b084-bd877522e74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:12.546201 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-a98b9c05-9a46-438d-b084-bd877522e74a None None] MFA Rules not processed for user `1b611fb0a3264773a629b80f23fb974c`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:12.547810 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a98b9c05-9a46-438d-b084-bd877522e74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:12.637553 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 620/1253] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:48:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:12.646178 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619764-74dc-4165-950f-2ce969f7a4b3 service glance] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:12.656298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619764-74dc-4165-950f-2ce969f7a4b3 service glance] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:12.660496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5dfb8c97854d37b07ef8474a54e483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:12.661120 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:12.661397 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:12.661712 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:12.671054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:12.729859 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:12.732551 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:12.746671 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 634/1254] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:48:12.954060 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79b80-181c-44ca-9f24-dbc23c8b419e None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:12.954584 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79b80-181c-44ca-9f24-dbc23c8b419e None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:12.954584 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79b80-181c-44ca-9f24-dbc23c8b419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:13.032767 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-11a79b80-181c-44ca-9f24-dbc23c8b419e None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:13.034220 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-11a79b80-181c-44ca-9f24-dbc23c8b419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:13.131800 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:13.168152 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 621/1255] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:48:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:13.280439 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:13.282044 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:13.376114 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49e7d-db53-4350-aa01-2e9803ab9b5c service glance] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:13.381212 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad213-302d-4937-b054-5604c0a7bf48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:13.381850 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad213-302d-4937-b054-5604c0a7bf48 service swift] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:13.382130 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad213-302d-4937-b054-5604c0a7bf48 service swift] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:13.382404 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad213-302d-4937-b054-5604c0a7bf48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:13.392133 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad213-302d-4937-b054-5604c0a7bf48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:13.393816 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad213-302d-4937-b054-5604c0a7bf48 service swift] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:13.402785 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 635/1256] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:48:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:48:13.722682 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfe06b-b775-45c7-b29b-f177281efcc0 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:13.722962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfe06b-b775-45c7-b29b-f177281efcc0 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:13.723231 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfe06b-b775-45c7-b29b-f177281efcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:13.748430 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-39dfe06b-b775-45c7-b29b-f177281efcc0 None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:13.749907 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-39dfe06b-b775-45c7-b29b-f177281efcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:13.758500 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 622/1257] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:48:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:13.773502 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad213-302d-4937-b054-5604c0a7bf48 service swift] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:13.784838 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad213-302d-4937-b054-5604c0a7bf48 service swift] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:13.791535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804146d6-5cd2-45b9-9dec-6b64392f659d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:13.791535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804146d6-5cd2-45b9-9dec-6b64392f659d service swift] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:13.791830 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804146d6-5cd2-45b9-9dec-6b64392f659d service swift] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:13.791929 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804146d6-5cd2-45b9-9dec-6b64392f659d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:13.801672 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804146d6-5cd2-45b9-9dec-6b64392f659d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:13.803300 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804146d6-5cd2-45b9-9dec-6b64392f659d service swift] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:13.815112 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 636/1258] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:48:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:48:23.650606 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e345e-b683-466f-904d-5222cfc842f8 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:23.651227 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e345e-b683-466f-904d-5222cfc842f8 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:23.651227 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e345e-b683-466f-904d-5222cfc842f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:23.671576 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-cc9e345e-b683-466f-904d-5222cfc842f8 None None] MFA Rules not processed for user `8c5371ed06de4936a51805b8feab3613`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:23.672822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-cc9e345e-b683-466f-904d-5222cfc842f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:23.679865 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 623/1259] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:48:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:23.809968 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=70 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:23.987157 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501144bb-5863-47a1-8bbe-be8bb2062eef None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:23.987448 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501144bb-5863-47a1-8bbe-be8bb2062eef None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:23.987710 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501144bb-5863-47a1-8bbe-be8bb2062eef None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:23.989058 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 637/1260] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 24 08:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:48:23.995177 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a5c14-3413-428a-b9c1-c88c832c9d22 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:23.995460 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a5c14-3413-428a-b9c1-c88c832c9d22 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:23.995730 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a5c14-3413-428a-b9c1-c88c832c9d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:24.033311 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-ed6a5c14-3413-428a-b9c1-c88c832c9d22 None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:24.034536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-ed6a5c14-3413-428a-b9c1-c88c832c9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:24.100656 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 624/1261] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 24 08:48:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:24.105937 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0d71-7542-43a3-890e-d8ce2172bb09 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:24.106935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0d71-7542-43a3-890e-d8ce2172bb09 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:24.107211 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0d71-7542-43a3-890e-d8ce2172bb09 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:24.108541 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 638/1262] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 24 08:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:48:24.113156 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4976-4ae0-4497-b893-58556fc0fcb8 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:24.113456 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4976-4ae0-4497-b893-58556fc0fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:24.113730 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b4976-4ae0-4497-b893-58556fc0fcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:24.133206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-645b4976-4ae0-4497-b893-58556fc0fcb8 None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:24.134434 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-645b4976-4ae0-4497-b893-58556fc0fcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:24.143768 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 625/1263] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:24.156112 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e0d71-7542-43a3-890e-d8ce2172bb09 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:24.157930 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-765e0d71-7542-43a3-890e-d8ce2172bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:24.172407 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e0d71-7542-43a3-890e-d8ce2172bb09 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:24.175932 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093a8f1-a1c9-4a34-925d-2bbfa70cbf93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5dfb8c97854d37b07ef8474a54e483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:24.176515 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a8f1-a1c9-4a34-925d-2bbfa70cbf93 service glance] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:24.176785 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a8f1-a1c9-4a34-925d-2bbfa70cbf93 service glance] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:24.177050 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a8f1-a1c9-4a34-925d-2bbfa70cbf93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:24.187659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093a8f1-a1c9-4a34-925d-2bbfa70cbf93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:24.189103 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093a8f1-a1c9-4a34-925d-2bbfa70cbf93 service glance] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:24.202257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 639/1264] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:48:24.568296 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973122f3-7782-4164-893e-b536f7b3e0d3 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:24.568579 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973122f3-7782-4164-893e-b536f7b3e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:24.568861 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973122f3-7782-4164-893e-b536f7b3e0d3 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:24.570262 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 626/1265] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 24 08:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:48:24.578438 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bbd9e-cdd5-47b0-b3b2-4137e0959bdd None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:24.578805 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bbd9e-cdd5-47b0-b3b2-4137e0959bdd None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:24.579362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bbd9e-cdd5-47b0-b3b2-4137e0959bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:24.619533 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-7b9bbd9e-cdd5-47b0-b3b2-4137e0959bdd None None] MFA Rules not processed for user `2facaae2a22448bcb52811b9cee5f0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:24.620730 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-7b9bbd9e-cdd5-47b0-b3b2-4137e0959bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:24.672489 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 640/1266] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:48:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:24.683813 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973122f3-7782-4164-893e-b536f7b3e0d3 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:24.694942 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973122f3-7782-4164-893e-b536f7b3e0d3 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:24.699026 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7538dc-5010-43d7-9cd9-a95ab2eee4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:24.699684 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7538dc-5010-43d7-9cd9-a95ab2eee4bd service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:24.700495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7538dc-5010-43d7-9cd9-a95ab2eee4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:24.700766 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7538dc-5010-43d7-9cd9-a95ab2eee4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:24.707762 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7538dc-5010-43d7-9cd9-a95ab2eee4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:24.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7538dc-5010-43d7-9cd9-a95ab2eee4bd service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:24.716762 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 627/1267] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:48:25.245591 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c2e94-3b9d-4b13-914b-5d5150e87482 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:25.246373 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c2e94-3b9d-4b13-914b-5d5150e87482 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:25.246863 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c2e94-3b9d-4b13-914b-5d5150e87482 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:25.248419 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 641/1268] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 24 08:48:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:48:25.258136 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7538dc-5010-43d7-9cd9-a95ab2eee4bd service neutron] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:25.260859 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d23ae-cae3-431b-8ec1-d038e0777e03 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:25.261138 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d23ae-cae3-431b-8ec1-d038e0777e03 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:25.261403 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d23ae-cae3-431b-8ec1-d038e0777e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:25.287203 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-c71d23ae-cae3-431b-8ec1-d038e0777e03 None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:25.288532 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-c71d23ae-cae3-431b-8ec1-d038e0777e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:25.299690 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 642/1269] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 24 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:48:25.305424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c683d9-c3a3-41d9-be7a-5fe42433d1fa None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:25.305424 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c683d9-c3a3-41d9-be7a-5fe42433d1fa None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:25.305683 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c683d9-c3a3-41d9-be7a-5fe42433d1fa None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:25.307049 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 643/1270] 10.222.0.23 () {54 vars in 912 bytes} [Mon Oct 24 08:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:48:25.312960 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc797f-d95e-4370-a3cd-21b02ee499ae None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:25.313319 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc797f-d95e-4370-a3cd-21b02ee499ae None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:25.314013 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc797f-d95e-4370-a3cd-21b02ee499ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:25.336204 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-6adc797f-d95e-4370-a3cd-21b02ee499ae None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:25.337431 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-6adc797f-d95e-4370-a3cd-21b02ee499ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:25.338199 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7538dc-5010-43d7-9cd9-a95ab2eee4bd service neutron] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:25.343745 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ac278-a4d3-4027-9146-5e2d1e674c75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd207dc4d9105430cb337641d736b318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:25.344357 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac278-a4d3-4027-9146-5e2d1e674c75 service placement] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:25.344637 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac278-a4d3-4027-9146-5e2d1e674c75 service placement] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:25.344910 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac278-a4d3-4027-9146-5e2d1e674c75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:25.347896 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-214ac278-a4d3-4027-9146-5e2d1e674c75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:25.352069 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 644/1271] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:25.364282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc797f-d95e-4370-a3cd-21b02ee499ae None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:25.364415 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ac278-a4d3-4027-9146-5e2d1e674c75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:25.365994 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ac278-a4d3-4027-9146-5e2d1e674c75 service placement] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:25.375856 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc797f-d95e-4370-a3cd-21b02ee499ae None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:25.377522 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 628/1272] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:48:25.380344 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be1844-550b-4a59-9ea3-821354e74b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:25.380959 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1844-550b-4a59-9ea3-821354e74b47 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:25.381970 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1844-550b-4a59-9ea3-821354e74b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:25.382400 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1844-550b-4a59-9ea3-821354e74b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:25.394235 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be1844-550b-4a59-9ea3-821354e74b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:25.395666 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be1844-550b-4a59-9ea3-821354e74b47 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:25.408460 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 645/1273] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:48:27.181853 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfb07a-faba-44e3-b11b-f88ec00394d5 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:27.182374 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfb07a-faba-44e3-b11b-f88ec00394d5 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:27.182715 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfb07a-faba-44e3-b11b-f88ec00394d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:27.207232 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-c8dfb07a-faba-44e3-b11b-f88ec00394d5 None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:27.216876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-c8dfb07a-faba-44e3-b11b-f88ec00394d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:27.234903 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 629/1274] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:48:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:27.247182 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be1844-550b-4a59-9ea3-821354e74b47 service neutron] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:27.258579 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be1844-550b-4a59-9ea3-821354e74b47 service neutron] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:27.264232 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622c270-2526-4f78-aa80-3631121aa854 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:27.264841 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622c270-2526-4f78-aa80-3631121aa854 service swift] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:27.265118 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622c270-2526-4f78-aa80-3631121aa854 service swift] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:27.265389 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622c270-2526-4f78-aa80-3631121aa854 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:27.274253 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622c270-2526-4f78-aa80-3631121aa854 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:27.275853 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622c270-2526-4f78-aa80-3631121aa854 service swift] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:27.285885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 646/1275] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:48:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:48:35.642405 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997c68e-44ed-445b-9774-71e6e9ec5623 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:35.643168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997c68e-44ed-445b-9774-71e6e9ec5623 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:35.643168 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997c68e-44ed-445b-9774-71e6e9ec5623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:35.662276 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-f997c68e-44ed-445b-9774-71e6e9ec5623 None None] MFA Rules not processed for user `2facaae2a22448bcb52811b9cee5f0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:35.663462 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f997c68e-44ed-445b-9774-71e6e9ec5623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:35.670197 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 630/1276] 10.222.0.46 () {58 vars in 1015 bytes} [Mon Oct 24 08:48:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:35.682745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622c270-2526-4f78-aa80-3631121aa854 service swift] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:35.694227 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622c270-2526-4f78-aa80-3631121aa854 service swift] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:35.698145 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c456f-00d7-4d24-936a-223598b280ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:35.698774 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c456f-00d7-4d24-936a-223598b280ce service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:35.699046 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c456f-00d7-4d24-936a-223598b280ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:35.699310 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c456f-00d7-4d24-936a-223598b280ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:35.708751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c456f-00d7-4d24-936a-223598b280ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:35.710252 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c456f-00d7-4d24-936a-223598b280ce service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:35.720707 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 647/1277] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:48:36.710533 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c727b-39b0-438e-92a7-703672189abe None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:36.711260 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c727b-39b0-438e-92a7-703672189abe None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:36.711260 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c727b-39b0-438e-92a7-703672189abe None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:36.713335 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 631/1278] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 24 08:48:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:48:36.743884 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5d8f-8bb2-47ba-bae1-7fc02bb5deee None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:36.744817 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5d8f-8bb2-47ba-bae1-7fc02bb5deee None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:36.745089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5d8f-8bb2-47ba-bae1-7fc02bb5deee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:36.768324 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-0d9c5d8f-8bb2-47ba-bae1-7fc02bb5deee None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:36.769659 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-0d9c5d8f-8bb2-47ba-bae1-7fc02bb5deee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:36.780314 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 648/1279] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 24 08:48:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:36.814958 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c727b-39b0-438e-92a7-703672189abe None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:36.825350 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:36.831502 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c727b-39b0-438e-92a7-703672189abe None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:36.836952 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7749bc-3e24-4227-b939-ffc6a4cbdae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:36.837664 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7749bc-3e24-4227-b939-ffc6a4cbdae0 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:36.838049 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7749bc-3e24-4227-b939-ffc6a4cbdae0 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:36.838390 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7749bc-3e24-4227-b939-ffc6a4cbdae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:36.848173 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7749bc-3e24-4227-b939-ffc6a4cbdae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:36.849879 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7749bc-3e24-4227-b939-ffc6a4cbdae0 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:36.861967 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 632/1280] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:48:43.531752 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa900-d4f2-4a30-b88d-5ab4da94e4b8 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:43.532416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa900-d4f2-4a30-b88d-5ab4da94e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:43.532416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa900-d4f2-4a30-b88d-5ab4da94e4b8 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:43.533652 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 649/1281] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 24 08:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:48:43.543599 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1092-8e37-481f-b5b5-39f2b5af2136 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:43.544225 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1092-8e37-481f-b5b5-39f2b5af2136 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:43.544446 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1092-8e37-481f-b5b5-39f2b5af2136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:43.566629 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-5a9c1092-8e37-481f-b5b5-39f2b5af2136 None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:43.567837 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-5a9c1092-8e37-481f-b5b5-39f2b5af2136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:43.578644 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 633/1282] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 24 08:48:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:43.593304 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa900-d4f2-4a30-b88d-5ab4da94e4b8 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:43.608559 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa900-d4f2-4a30-b88d-5ab4da94e4b8 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:43.614009 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add63564-57cb-4674-aed4-8226e5a8a18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:43.614619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add63564-57cb-4674-aed4-8226e5a8a18f service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:43.614895 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add63564-57cb-4674-aed4-8226e5a8a18f service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:43.615162 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add63564-57cb-4674-aed4-8226e5a8a18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:43.625078 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add63564-57cb-4674-aed4-8226e5a8a18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:43.626652 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add63564-57cb-4674-aed4-8226e5a8a18f service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:43.638327 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 650/1283] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:48:53.560899 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=7 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:53.632942 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=68 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:02.155548 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c1092-8e37-481f-b5b5-39f2b5af2136 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:49:02.164792 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c1092-8e37-481f-b5b5-39f2b5af2136 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:49:02.168348 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf53905-7825-4eb4-9421-2b658076c496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:49:02.168932 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53905-7825-4eb4-9421-2b658076c496 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:02.169203 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53905-7825-4eb4-9421-2b658076c496 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:02.169498 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53905-7825-4eb4-9421-2b658076c496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:02.178831 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf53905-7825-4eb4-9421-2b658076c496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:49:02.180248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf53905-7825-4eb4-9421-2b658076c496 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:49:02.189379 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 634/1284] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:49:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:49:09.947469 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34508f-b23a-4f31-92f5-cbfcef6007fc None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:09.947991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34508f-b23a-4f31-92f5-cbfcef6007fc None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:09.947991 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34508f-b23a-4f31-92f5-cbfcef6007fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:09.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-0c34508f-b23a-4f31-92f5-cbfcef6007fc None None] MFA Rules not processed for user `140ef0ddf6a54c72a2b67953fae03b26`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:49:09.967812 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-0c34508f-b23a-4f31-92f5-cbfcef6007fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:09.974670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 651/1285] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:49:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:49:10.473964 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd85f0f-dd65-4d09-b274-8e0c2766d5a4 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:10.474480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd85f0f-dd65-4d09-b274-8e0c2766d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:10.474480 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd85f0f-dd65-4d09-b274-8e0c2766d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:10.494590 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-6fd85f0f-dd65-4d09-b274-8e0c2766d5a4 None None] MFA Rules not processed for user `2facaae2a22448bcb52811b9cee5f0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:49:10.495773 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-6fd85f0f-dd65-4d09-b274-8e0c2766d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:10.502522 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 635/1286] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:49:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:49:10.514115 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34508f-b23a-4f31-92f5-cbfcef6007fc None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:49:10.523793 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34508f-b23a-4f31-92f5-cbfcef6007fc None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:49:10.527407 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bbf00-f654-4b01-a0ed-825f3963f9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:49:10.528015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bbf00-f654-4b01-a0ed-825f3963f9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:10.528289 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bbf00-f654-4b01-a0ed-825f3963f9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:10.528562 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bbf00-f654-4b01-a0ed-825f3963f9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:10.536515 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bbf00-f654-4b01-a0ed-825f3963f9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:49:10.537979 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bbf00-f654-4b01-a0ed-825f3963f9d7 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:49:10.546765 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 652/1287] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:49:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:49:20.489553 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=9 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:20.542449 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=9 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:50.819195 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786c9a-c191-47c7-a56c-d8531caaef98 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:50.819722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786c9a-c191-47c7-a56c-d8531caaef98 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:50.819722 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de786c9a-c191-47c7-a56c-d8531caaef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:50.838929 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-de786c9a-c191-47c7-a56c-d8531caaef98 None None] MFA Rules not processed for user `140ef0ddf6a54c72a2b67953fae03b26`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:49:50.840723 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-de786c9a-c191-47c7-a56c-d8531caaef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:50.847501 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 636/1288] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:00.833699 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:08.169000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91a13-818d-40c7-bfbb-ee95f3db58bc None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:08.169564 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91a13-818d-40c7-bfbb-ee95f3db58bc None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:08.169651 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91a13-818d-40c7-bfbb-ee95f3db58bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:08.190008 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-dfd91a13-818d-40c7-bfbb-ee95f3db58bc None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:08.191288 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-dfd91a13-818d-40c7-bfbb-ee95f3db58bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:08.198568 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 653/1289] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:50:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:08.240802 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de786c9a-c191-47c7-a56c-d8531caaef98 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:08.253033 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de786c9a-c191-47c7-a56c-d8531caaef98 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:08.257997 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a129af9-3bc0-4884-81e4-3ab317d416f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:08.258599 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129af9-3bc0-4884-81e4-3ab317d416f1 service swift] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:08.259467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129af9-3bc0-4884-81e4-3ab317d416f1 service swift] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:08.259467 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129af9-3bc0-4884-81e4-3ab317d416f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:08.268417 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a129af9-3bc0-4884-81e4-3ab317d416f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:08.270046 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a129af9-3bc0-4884-81e4-3ab317d416f1 service swift] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:08.279347 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 637/1290] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:50:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:11.613072 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b5b2-8d3d-4adb-8f16-72e852da3bc2 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:11.613636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b5b2-8d3d-4adb-8f16-72e852da3bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:11.613636 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b5b2-8d3d-4adb-8f16-72e852da3bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:11.632829 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-f977b5b2-8d3d-4adb-8f16-72e852da3bc2 None None] MFA Rules not processed for user `140ef0ddf6a54c72a2b67953fae03b26`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:11.634048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f977b5b2-8d3d-4adb-8f16-72e852da3bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:11.641512 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 654/1291] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:50:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:18.274876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=6 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:21.628126 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=6 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:38.172033 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36a79-194e-465f-b624-e9cbdc53340a None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:38.172669 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36a79-194e-465f-b624-e9cbdc53340a None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:38.172669 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36a79-194e-465f-b624-e9cbdc53340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:38.193797 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-09d36a79-194e-465f-b624-e9cbdc53340a None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:38.194959 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-09d36a79-194e-465f-b624-e9cbdc53340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:38.203058 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 638/1292] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 24 08:50:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:38.218510 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b5b2-8d3d-4adb-8f16-72e852da3bc2 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:38.231623 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b5b2-8d3d-4adb-8f16-72e852da3bc2 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:38.237127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2a835-91e4-48a2-b441-5c1d0283178d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:38.237773 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2a835-91e4-48a2-b441-5c1d0283178d service swift] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:38.238055 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2a835-91e4-48a2-b441-5c1d0283178d service swift] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:38.238324 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2a835-91e4-48a2-b441-5c1d0283178d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:38.248263 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2a835-91e4-48a2-b441-5c1d0283178d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:38.250669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2a835-91e4-48a2-b441-5c1d0283178d service swift] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:38.261256 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 655/1293] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:50:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:48.187770 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:48.256797 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=6 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:56.391515 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f37416-74fc-481b-ac38-952425944ff0 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.392096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f37416-74fc-481b-ac38-952425944ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.392096 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f37416-74fc-481b-ac38-952425944ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.412765 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-b5f37416-74fc-481b-ac38-952425944ff0 None None] MFA Rules not processed for user `140ef0ddf6a54c72a2b67953fae03b26`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:56.414094 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-b5f37416-74fc-481b-ac38-952425944ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.422009 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 639/1294] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:50:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:06.406727 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:12.891498 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2a835-91e4-48a2-b441-5c1d0283178d service swift] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:12.908619 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2a835-91e4-48a2-b441-5c1d0283178d service swift] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:12.915118 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf5c8-67fb-430b-bc0b-5c2a6a4a98f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:12.916868 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf5c8-67fb-430b-bc0b-5c2a6a4a98f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:12.917362 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf5c8-67fb-430b-bc0b-5c2a6a4a98f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:12.917862 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf5c8-67fb-430b-bc0b-5c2a6a4a98f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:12.935015 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf5c8-67fb-430b-bc0b-5c2a6a4a98f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:12.937967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf5c8-67fb-430b-bc0b-5c2a6a4a98f3 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:12.956462 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 656/1295] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:16.455219 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899cd1-38d8-49fa-9fa1-a14b70673fcc None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.456216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899cd1-38d8-49fa-9fa1-a14b70673fcc None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.456216 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899cd1-38d8-49fa-9fa1-a14b70673fcc None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.461906 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 640/1296] 10.222.0.23 () {54 vars in 961 bytes} [Mon Oct 24 08:51:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:16.468585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f533-3ee5-476b-b681-cb2c1fd6fcf7 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.469280 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f533-3ee5-476b-b681-cb2c1fd6fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.469728 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f533-3ee5-476b-b681-cb2c1fd6fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.503114 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-71a2f533-3ee5-476b-b681-cb2c1fd6fcf7 None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:16.504817 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-71a2f533-3ee5-476b-b681-cb2c1fd6fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:16.519912 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 657/1297] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Oct 24 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:16.536039 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899cd1-38d8-49fa-9fa1-a14b70673fcc None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:16.565371 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899cd1-38d8-49fa-9fa1-a14b70673fcc None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:16.575267 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8922a-8c68-401e-9f5c-645e0608dd90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd207dc4d9105430cb337641d736b318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:16.576631 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8922a-8c68-401e-9f5c-645e0608dd90 service placement] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.577241 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8922a-8c68-401e-9f5c-645e0608dd90 service placement] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.577949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8922a-8c68-401e-9f5c-645e0608dd90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.595195 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8922a-8c68-401e-9f5c-645e0608dd90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:16.598680 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8922a-8c68-401e-9f5c-645e0608dd90 service placement] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:16.621213 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 641/1298] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:26.495409 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=9 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:26.611484 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=6 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:18.974221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a47f3-6285-4478-b868-742c2b32dded None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.974221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a47f3-6285-4478-b868-742c2b32dded None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.974221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a47f3-6285-4478-b868-742c2b32dded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.994874 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-ea5a47f3-6285-4478-b868-742c2b32dded None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:18.996337 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-ea5a47f3-6285-4478-b868-742c2b32dded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:19.006696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 658/1299] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 24 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:19.066423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8922a-8c68-401e-9f5c-645e0608dd90 service placement] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:19.078332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8922a-8c68-401e-9f5c-645e0608dd90 service placement] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:19.084784 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa07f7-f2ca-471c-86fd-a1999ad7b8da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:19.086593 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa07f7-f2ca-471c-86fd-a1999ad7b8da service swift] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:19.086593 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa07f7-f2ca-471c-86fd-a1999ad7b8da service swift] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:19.086905 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa07f7-f2ca-471c-86fd-a1999ad7b8da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:19.097755 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa07f7-f2ca-471c-86fd-a1999ad7b8da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:19.099359 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa07f7-f2ca-471c-86fd-a1999ad7b8da service swift] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:19.109796 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 642/1300] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:52:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:19.643944 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0247a4-5240-418c-b2c8-22d051b1461c None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:19.644349 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0247a4-5240-418c-b2c8-22d051b1461c None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:19.644733 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0247a4-5240-418c-b2c8-22d051b1461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:19.669066 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-1b0247a4-5240-418c-b2c8-22d051b1461c None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:19.670347 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-1b0247a4-5240-418c-b2c8-22d051b1461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:19.677764 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 659/1301] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:19.691805 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa07f7-f2ca-471c-86fd-a1999ad7b8da service swift] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:19.703034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa07f7-f2ca-471c-86fd-a1999ad7b8da service swift] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:19.708589 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeab649-ac63-4e55-bbac-8ed6d24d1ca4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:19.709225 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeab649-ac63-4e55-bbac-8ed6d24d1ca4 service swift] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:19.709542 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeab649-ac63-4e55-bbac-8ed6d24d1ca4 service swift] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:19.709816 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeab649-ac63-4e55-bbac-8ed6d24d1ca4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:19.719160 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeab649-ac63-4e55-bbac-8ed6d24d1ca4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:19.720888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeab649-ac63-4e55-bbac-8ed6d24d1ca4 service swift] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:19.730690 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 643/1302] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:52:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:29.068269 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd31348-3181-4375-b959-1e194e401362 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:29.068953 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd31348-3181-4375-b959-1e194e401362 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:29.068953 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd31348-3181-4375-b959-1e194e401362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:29.091617 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-ccd31348-3181-4375-b959-1e194e401362 None None] MFA Rules not processed for user `8c5371ed06de4936a51805b8feab3613`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:29.092858 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-ccd31348-3181-4375-b959-1e194e401362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:29.100143 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 660/1303] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:52:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:29.726964 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=12 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:31.276489 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d989-7b0f-4079-82da-6be048016292 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:31.277159 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d989-7b0f-4079-82da-6be048016292 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:31.277159 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d989-7b0f-4079-82da-6be048016292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:31.305196 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-0457d989-7b0f-4079-82da-6be048016292 None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:31.306365 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-0457d989-7b0f-4079-82da-6be048016292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:31.313966 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 644/1304] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Oct 24 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:31.328501 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd31348-3181-4375-b959-1e194e401362 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:31.341413 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd31348-3181-4375-b959-1e194e401362 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:31.349221 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337a854-4850-45b4-8a0e-ecbe6140a925 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:31.350259 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a854-4850-45b4-8a0e-ecbe6140a925 service swift] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:31.350661 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a854-4850-45b4-8a0e-ecbe6140a925 service swift] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:31.351497 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a854-4850-45b4-8a0e-ecbe6140a925 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:31.361298 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a854-4850-45b4-8a0e-ecbe6140a925 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:31.364067 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a854-4850-45b4-8a0e-ecbe6140a925 service swift] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:31.377613 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 661/1305] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 08:52:41.297532 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=3 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:41.371903 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=15 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:12.262115 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d989-7b0f-4079-82da-6be048016292 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:12.275395 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d989-7b0f-4079-82da-6be048016292 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:12.280782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d3910-9fc8-4afd-bc93-e80e60cf7b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:12.281380 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d3910-9fc8-4afd-bc93-e80e60cf7b73 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:12.281681 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d3910-9fc8-4afd-bc93-e80e60cf7b73 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:12.281956 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d3910-9fc8-4afd-bc93-e80e60cf7b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:12.290452 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d3910-9fc8-4afd-bc93-e80e60cf7b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:12.292019 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d3910-9fc8-4afd-bc93-e80e60cf7b73 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:12.300641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 645/1306] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:14.647714 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac79cf-bd1b-46c7-92f7-9f84f070baaf None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:14.648191 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac79cf-bd1b-46c7-92f7-9f84f070baaf None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:14.648282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac79cf-bd1b-46c7-92f7-9f84f070baaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:14.667287 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-f4ac79cf-bd1b-46c7-92f7-9f84f070baaf None None] MFA Rules not processed for user `140ef0ddf6a54c72a2b67953fae03b26`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:14.668539 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-f4ac79cf-bd1b-46c7-92f7-9f84f070baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:14.675707 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 662/1307] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:53:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:53:22.296741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=6 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:23.672599 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d3910-9fc8-4afd-bc93-e80e60cf7b73 service nova] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:23.684279 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d3910-9fc8-4afd-bc93-e80e60cf7b73 service nova] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:23.689880 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572f07c-fd07-4206-ba39-61b6a05d9db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:23.690495 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f07c-fd07-4206-ba39-61b6a05d9db0 service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:23.690769 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f07c-fd07-4206-ba39-61b6a05d9db0 service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:23.691040 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f07c-fd07-4206-ba39-61b6a05d9db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:23.700361 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572f07c-fd07-4206-ba39-61b6a05d9db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:23.702084 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572f07c-fd07-4206-ba39-61b6a05d9db0 service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:23.712867 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 646/1308] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:24.106111 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac79cf-bd1b-46c7-92f7-9f84f070baaf None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:24.130154 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac79cf-bd1b-46c7-92f7-9f84f070baaf None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:24.142638 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055cff-01f2-45ed-b5e8-592355dd6482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:24.143587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055cff-01f2-45ed-b5e8-592355dd6482 service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:24.144205 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055cff-01f2-45ed-b5e8-592355dd6482 service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:24.144697 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055cff-01f2-45ed-b5e8-592355dd6482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:24.158296 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055cff-01f2-45ed-b5e8-592355dd6482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:24.159770 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055cff-01f2-45ed-b5e8-592355dd6482 service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:24.173526 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 663/1309] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:25.217872 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572f07c-fd07-4206-ba39-61b6a05d9db0 service nova] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:25.228865 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572f07c-fd07-4206-ba39-61b6a05d9db0 service nova] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:25.232801 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cc145-5a40-456c-b573-fab113b48b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:25.233343 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc145-5a40-456c-b573-fab113b48b1c service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:25.233649 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc145-5a40-456c-b573-fab113b48b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:25.233918 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc145-5a40-456c-b573-fab113b48b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:25.246384 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cc145-5a40-456c-b573-fab113b48b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:25.247829 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cc145-5a40-456c-b573-fab113b48b1c service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:25.262454 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 647/1310] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:34.166931 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=9 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:35.256604 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=12 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:35.328592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055cff-01f2-45ed-b5e8-592355dd6482 service neutron] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:35.338535 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055cff-01f2-45ed-b5e8-592355dd6482 service neutron] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:35.342574 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473b02f-9d47-4d2b-af91-053a12a50c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:35.343229 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b02f-9d47-4d2b-af91-053a12a50c4f service neutron] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:35.343503 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b02f-9d47-4d2b-af91-053a12a50c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:35.343933 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b02f-9d47-4d2b-af91-053a12a50c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:35.352670 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473b02f-9d47-4d2b-af91-053a12a50c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:35.354177 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473b02f-9d47-4d2b-af91-053a12a50c4f service neutron] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:35.367282 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 664/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:53:45.360449 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=6 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:10.523537 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cc145-5a40-456c-b573-fab113b48b1c service neutron] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:10.552316 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cc145-5a40-456c-b573-fab113b48b1c service neutron] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:10.559428 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f70d-5466-4fc4-8a8b-922d9f77ab6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:10.560393 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f70d-5466-4fc4-8a8b-922d9f77ab6e service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:10.560684 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f70d-5466-4fc4-8a8b-922d9f77ab6e service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:10.561029 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f70d-5466-4fc4-8a8b-922d9f77ab6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:10.573904 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f70d-5466-4fc4-8a8b-922d9f77ab6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:10.575641 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f70d-5466-4fc4-8a8b-922d9f77ab6e service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:10.591312 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 648/1312] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:11.909922 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c880-109f-48d3-9f8d-31998f5cec8b None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:11.911615 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c880-109f-48d3-9f8d-31998f5cec8b None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:11.911615 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c880-109f-48d3-9f8d-31998f5cec8b None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:11.912388 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 665/1313] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 24 08:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:54:11.917430 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e90b7e-22b6-4fee-b03b-e03ef03e5bfa None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:11.917951 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e90b7e-22b6-4fee-b03b-e03ef03e5bfa None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:11.918071 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e90b7e-22b6-4fee-b03b-e03ef03e5bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:11.940602 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-19e90b7e-22b6-4fee-b03b-e03ef03e5bfa None None] MFA Rules not processed for user `5ccd68808df34afb9bc08db5bdd6afa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:11.942438 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-19e90b7e-22b6-4fee-b03b-e03ef03e5bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:11.955592 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 649/1314] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 24 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:11.966945 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c880-109f-48d3-9f8d-31998f5cec8b None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:11.985061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c880-109f-48d3-9f8d-31998f5cec8b None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:11.993081 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e145d-24eb-4893-b709-03567dbeb340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:11.993913 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e145d-24eb-4893-b709-03567dbeb340 service nova] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:11.994394 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e145d-24eb-4893-b709-03567dbeb340 service nova] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:11.994751 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e145d-24eb-4893-b709-03567dbeb340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:12.006513 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e145d-24eb-4893-b709-03567dbeb340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:12.008143 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e145d-24eb-4893-b709-03567dbeb340 service nova] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:12.020625 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 666/1315] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:18.274421 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1237-b2c8-4bd6-9ecc-f1ca993a5b19 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:18.274902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1237-b2c8-4bd6-9ecc-f1ca993a5b19 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:18.275000 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1237-b2c8-4bd6-9ecc-f1ca993a5b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:18.296237 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-265d1237-b2c8-4bd6-9ecc-f1ca993a5b19 None None] MFA Rules not processed for user `a351023812dd4bd2ad078374bab98b89`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:18.297423 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-265d1237-b2c8-4bd6-9ecc-f1ca993a5b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:18.305386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 650/1316] 10.222.0.23 () {58 vars in 967 bytes} [Mon Oct 24 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:18.348395 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e145d-24eb-4893-b709-03567dbeb340 service nova] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:18.359923 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e145d-24eb-4893-b709-03567dbeb340 service nova] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:18.365962 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc6045-6fb4-415e-8a75-b564487976fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf84d9f0ae734f04aa277f8624b7bd45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:18.366590 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc6045-6fb4-415e-8a75-b564487976fd service swift] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:18.366865 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc6045-6fb4-415e-8a75-b564487976fd service swift] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:18.367147 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc6045-6fb4-415e-8a75-b564487976fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:18.376380 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc6045-6fb4-415e-8a75-b564487976fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:18.378109 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc6045-6fb4-415e-8a75-b564487976fd service swift] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:18.388565 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 667/1317] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Oct 24 08:54:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 08:54:18.770935 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1237-b2c8-4bd6-9ecc-f1ca993a5b19 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:18.780193 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1237-b2c8-4bd6-9ecc-f1ca993a5b19 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:18.783803 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23849fbd-b004-460a-921a-e40df22731a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:18.784418 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849fbd-b004-460a-921a-e40df22731a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:18.784696 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849fbd-b004-460a-921a-e40df22731a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:18.785082 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849fbd-b004-460a-921a-e40df22731a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:18.850409 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23849fbd-b004-460a-921a-e40df22731a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:18.851856 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23849fbd-b004-460a-921a-e40df22731a6 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:18.861332 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 651/1318] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:22.230509 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014cd8-8371-465f-8b58-4f5405f365f8 None None] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:22.231089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014cd8-8371-465f-8b58-4f5405f365f8 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:22.231089 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014cd8-8371-465f-8b58-4f5405f365f8 None None] PATH_INFO: `/` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:22.232876 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 668/1319] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 24 08:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:54:22.243386 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1cc8-90cf-460c-908c-9fc80d1d69b8 None None] REQUEST_METHOD: `POST` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:22.243962 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1cc8-90cf-460c-908c-9fc80d1d69b8 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:22.244176 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1cc8-90cf-460c-908c-9fc80d1d69b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:22.266690 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.auth.core [None req-f8bb1cc8-90cf-460c-908c-9fc80d1d69b8 None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:22.268009 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f8bb1cc8-90cf-460c-908c-9fc80d1d69b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:22.278486 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 652/1320] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 24 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:54:22.428127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b014cd8-8371-465f-8b58-4f5405f365f8 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:22.443475 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b014cd8-8371-465f-8b58-4f5405f365f8 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:22.451371 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73844fcb-7e2f-4217-921e-a2810a014904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd207dc4d9105430cb337641d736b318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:22.452226 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73844fcb-7e2f-4217-921e-a2810a014904 service placement] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:22.452444 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73844fcb-7e2f-4217-921e-a2810a014904 service placement] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:22.452805 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73844fcb-7e2f-4217-921e-a2810a014904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:22.462444 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73844fcb-7e2f-4217-921e-a2810a014904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:22.464052 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73844fcb-7e2f-4217-921e-a2810a014904 service placement] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:22.477416 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 669/1321] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:54:26.335203 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc073386-b6d2-4379-87cf-6e6f5b0ec7e8 None None] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:26.335741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc073386-b6d2-4379-87cf-6e6f5b0ec7e8 None None] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:26.335741 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc073386-b6d2-4379-87cf-6e6f5b0ec7e8 None None] PATH_INFO: `/` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:26.337139 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 653/1322] 10.222.0.23 () {54 vars in 921 bytes} [Mon Oct 24 08:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:54:26.349405 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d06ee4-8a80-4fc1-ba92-3ae5b90ec4a9 None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:26.349966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d06ee4-8a80-4fc1-ba92-3ae5b90ec4a9 None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:26.349966 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d06ee4-8a80-4fc1-ba92-3ae5b90ec4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:26.370550 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-d4d06ee4-8a80-4fc1-ba92-3ae5b90ec4a9 None None] MFA Rules not processed for user `d207dc4d9105430cb337641d736b318f`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:26.371776 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d4d06ee4-8a80-4fc1-ba92-3ae5b90ec4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:26.381461 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 670/1323] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Oct 24 08:54:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:26.399069 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc073386-b6d2-4379-87cf-6e6f5b0ec7e8 None None] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:26.421260 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc073386-b6d2-4379-87cf-6e6f5b0ec7e8 None None] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:26.429761 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d06ee4-8a80-4fc1-ba92-3ae5b90ec4a9 None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:26.431022 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d525b7-7161-4904-89c0-0ce34d734f5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd207dc4d9105430cb337641d736b318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:26.431642 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d525b7-7161-4904-89c0-0ce34d734f5f service placement] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:26.431913 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d525b7-7161-4904-89c0-0ce34d734f5f service placement] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:26.432181 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d525b7-7161-4904-89c0-0ce34d734f5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:26.441001 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d06ee4-8a80-4fc1-ba92-3ae5b90ec4a9 None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:26.441608 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d525b7-7161-4904-89c0-0ce34d734f5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:26.442955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d525b7-7161-4904-89c0-0ce34d734f5f service placement] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:26.445885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:26.446541 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:26.446817 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:26.447086 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] PATH_INFO: `/v3/users/8c5371ed06de4936a51805b8feab3613` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:26.448257 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5371ed06de4936a51805b8feab3613)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:26.450220 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:26.453681 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 654/1324] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:26.509829 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5371ed06de4936a51805b8feab3613'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.510533 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5371ed06de4936a51805b8feab3613'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.522885 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5371ed06de4936a51805b8feab3613'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.529732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5371ed06de4936a51805b8feab3613'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.530524 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5371ed06de4936a51805b8feab3613'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.544434 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 671/1325] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 24 08:54:26 2022] DELETE /identity/v3/users/8c5371ed06de4936a51805b8feab3613 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:26.731825 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d525b7-7161-4904-89c0-0ce34d734f5f service placement] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:26.750493 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d525b7-7161-4904-89c0-0ce34d734f5f service placement] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:26.811602 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:26.812238 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:26.812513 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:26.812779 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] PATH_INFO: `/v3/projects/0433756c9da14c448c57fc8b910b28f3` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:26.813926 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0433756c9da14c448c57fc8b910b28f3)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:26.815834 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:26.865263 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0433756c9da14c448c57fc8b910b28f3', 'request_id': 'req-feeb83ea-31b9-4341-b6db-2c072a0183e8'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.866466 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:26.871949 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0433756c9da14c448c57fc8b910b28f3', 'request_id': 'req-feeb83ea-31b9-4341-b6db-2c072a0183e8'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.884012 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0433756c9da14c448c57fc8b910b28f3', 'request_id': 'req-feeb83ea-31b9-4341-b6db-2c072a0183e8'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.897845 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] The token cache is being invalidate because project 0433756c9da14c448c57fc8b910b28f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:54:26.898130 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.898782 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:26.900275 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 655/1326] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:26 2022] DELETE /identity/v3/projects/0433756c9da14c448c57fc8b910b28f3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:54:26.904455 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:26.905901 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:26.919172 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248375e-999d-4d70-b0a4-b4464b70b22b admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:26.977754 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:26.978307 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:26.978581 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:26.978852 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] PATH_INFO: `/v3/users/1b611fb0a3264773a629b80f23fb974c` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:26.980001 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b611fb0a3264773a629b80f23fb974c)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:26.981947 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:27.012443 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:27.032589 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b611fb0a3264773a629b80f23fb974c'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.033246 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b611fb0a3264773a629b80f23fb974c'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.046127 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b611fb0a3264773a629b80f23fb974c'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.053419 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b611fb0a3264773a629b80f23fb974c'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.054302 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-76951949-6594-42e6-9c5a-880056dd029e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b611fb0a3264773a629b80f23fb974c'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.068892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 672/1327] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 24 08:54:26 2022] DELETE /identity/v3/users/1b611fb0a3264773a629b80f23fb974c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:27.262102 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:27.263566 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:27.278146 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb83ea-31b9-4341-b6db-2c072a0183e8 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:27.345881 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:27.346536 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:27.346787 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:27.347057 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] PATH_INFO: `/v3/projects/2a61c70ffd484af9904d667cb26df619` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:27.348210 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a61c70ffd484af9904d667cb26df619)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:27.350169 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:27.405049 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a61c70ffd484af9904d667cb26df619', 'request_id': 'req-aacfe1f7-db76-4961-8c51-638acb46bb48'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.410882 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a61c70ffd484af9904d667cb26df619', 'request_id': 'req-aacfe1f7-db76-4961-8c51-638acb46bb48'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.418090 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a61c70ffd484af9904d667cb26df619', 'request_id': 'req-aacfe1f7-db76-4961-8c51-638acb46bb48'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.430358 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] The token cache is being invalidate because project 2a61c70ffd484af9904d667cb26df619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:54:27.430639 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.431300 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.432822 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 656/1328] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:27 2022] DELETE /identity/v3/projects/2a61c70ffd484af9904d667cb26df619 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:37.064892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:37.427164 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=2 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:18.460060 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132966eb-1fda-41ef-b9ea-e3aa419a93af None None] REQUEST_METHOD: `POST` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:18.460631 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132966eb-1fda-41ef-b9ea-e3aa419a93af None None] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:18.460631 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132966eb-1fda-41ef-b9ea-e3aa419a93af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:18.480580 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.auth.core [None req-132966eb-1fda-41ef-b9ea-e3aa419a93af None None] MFA Rules not processed for user `140ef0ddf6a54c72a2b67953fae03b26`. Rule list: `[]` (Enabled: `True`). {{(pid=88335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:18.481839 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-132966eb-1fda-41ef-b9ea-e3aa419a93af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:18.540669 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 673/1329] 10.222.0.23 () {58 vars in 958 bytes} [Mon Oct 24 08:55:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:18.866621 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:18.868033 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:18.927340 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfe1f7-db76-4961-8c51-638acb46bb48 admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:18.930938 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:18.931546 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:18.931823 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:18.932095 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:18.933876 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:18.944550 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:18.946042 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:18.954263 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 657/1330] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:19.407479 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132966eb-1fda-41ef-b9ea-e3aa419a93af None None] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:19.411348 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-132966eb-1fda-41ef-b9ea-e3aa419a93af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:19.484017 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132966eb-1fda-41ef-b9ea-e3aa419a93af None None] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:19.490020 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd207dc4d9105430cb337641d736b318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:19.490632 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:19.490905 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:19.491173 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:19.492863 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:19.505559 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:19.507155 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:19.517068 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 674/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:28.950774 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=26 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:29.513329 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=57 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:32.781305 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:32.783351 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:32.862253 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183373-3aac-4dfd-b78f-5f090eef9ae1 service neutron] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:32.868206 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ccd68808df34afb9bc08db5bdd6afa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:32.868761 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:32.869042 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:32.869309 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:32.871162 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:32.884309 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:32.885946 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:32.897307 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 658/1332] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:42.892369 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=34 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:21.435502 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:21.436889 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:21.520824 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1c1ef-c8cd-490d-aea4-52461f18bdee service placement] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:21.525822 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd207dc4d9105430cb337641d736b318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:21.526426 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:21.526732 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:21.527000 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:21.528702 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:21.539935 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:21.541523 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:21.551705 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 675/1333] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:31.547061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=37 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:30.922610 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:30.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:30.989756 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ab15-e984-466f-a056-59bd764ccd1b service nova] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:30.993384 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2facaae2a22448bcb52811b9cee5f0fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:30.994008 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] REQUEST_METHOD: `GET` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:30.994282 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:30.994547 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:30.996248 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:31.082751 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:31.084217 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:31.103958 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 659/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:57:37.972488 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:37.974048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:37.989892 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf4d72-1ac9-4bbf-bc39-3c4ce14f5fc2 service placement] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:37.994745 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:37.995312 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:37.995587 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:37.995859 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] PATH_INFO: `/v3/users/140ef0ddf6a54c72a2b67953fae03b26` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:37.997008 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=140ef0ddf6a54c72a2b67953fae03b26)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:38.000062 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:38.048250 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140ef0ddf6a54c72a2b67953fae03b26'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.048917 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140ef0ddf6a54c72a2b67953fae03b26'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.063003 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140ef0ddf6a54c72a2b67953fae03b26'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.069897 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140ef0ddf6a54c72a2b67953fae03b26'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.070615 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140ef0ddf6a54c72a2b67953fae03b26'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.084242 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 676/1335] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:37 2022] DELETE /identity/v3/users/140ef0ddf6a54c72a2b67953fae03b26 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:38.262888 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:38.273153 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e4fc1-ca93-42c4-b462-63a4e5dd953c service neutron] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:38.334736 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:38.335363 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:38.335636 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:38.335902 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] PATH_INFO: `/v3/projects/5dc65275ea574b7fbf96a5a9210facac` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:38.336999 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc65275ea574b7fbf96a5a9210facac)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:38.338956 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:38.361753 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=100 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:38.388627 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc65275ea574b7fbf96a5a9210facac', 'request_id': 'req-e608f07a-c437-420d-b5f1-e83a1614bd6a'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.394128 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc65275ea574b7fbf96a5a9210facac', 'request_id': 'req-e608f07a-c437-420d-b5f1-e83a1614bd6a'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.401789 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc65275ea574b7fbf96a5a9210facac', 'request_id': 'req-e608f07a-c437-420d-b5f1-e83a1614bd6a'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.414165 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] The token cache is being invalidate because project 5dc65275ea574b7fbf96a5a9210facac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:38.414448 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.415101 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.416570 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 660/1336] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:38 2022] DELETE /identity/v3/projects/5dc65275ea574b7fbf96a5a9210facac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:38.421142 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:38.422592 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:38.435967 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbc427-12c2-4ac1-896d-995c98debf0e admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:38.492061 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:38.492696 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:38.492973 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:38.493243 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] PATH_INFO: `/v3/users/699326ddbb8a4b3b817e8a1eab6696bd` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:38.494396 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699326ddbb8a4b3b817e8a1eab6696bd)` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:38.496287 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:38.546762 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699326ddbb8a4b3b817e8a1eab6696bd'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.547496 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699326ddbb8a4b3b817e8a1eab6696bd'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.559588 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699326ddbb8a4b3b817e8a1eab6696bd'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.566663 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699326ddbb8a4b3b817e8a1eab6696bd'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.567510 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.notifications [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699326ddbb8a4b3b817e8a1eab6696bd'} {{(pid=88335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.568994 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:38.582421 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 677/1337] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:38 2022] DELETE /identity/v3/users/699326ddbb8a4b3b817e8a1eab6696bd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:38.765977 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] Authenticating user token {{(pid=88334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:38.767569 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.fernet_utils [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:38.786960 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608f07a-c437-420d-b5f1-e83a1614bd6a admin admin] Validating token access rules against request {{(pid=88334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:38.845185 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb436ff244d04b3cb3470051690a8e72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cecb417d1d674088b180055893a0ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:38.845758 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:38.846034 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:38.846306 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] PATH_INFO: `/v3/projects/ea44cebc50cb4257939c99d8c328ea58` {{(pid=88334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:38.847426 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea44cebc50cb4257939c99d8c328ea58)` {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:38.849334 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] RBAC: Authorization granted {{(pid=88334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:38.901955 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea44cebc50cb4257939c99d8c328ea58', 'request_id': 'req-a7964f61-21ab-41f7-abe9-e25317104a24'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.907571 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea44cebc50cb4257939c99d8c328ea58', 'request_id': 'req-a7964f61-21ab-41f7-abe9-e25317104a24'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.915240 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea44cebc50cb4257939c99d8c328ea58', 'request_id': 'req-a7964f61-21ab-41f7-abe9-e25317104a24'} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.927855 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] The token cache is being invalidate because project ea44cebc50cb4257939c99d8c328ea58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:38.928147 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.928883 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG keystone.notifications [None req-a7964f61-21ab-41f7-abe9-e25317104a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:38.930455 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: [pid: 88334|app: 0|req: 661/1338] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:38 2022] DELETE /identity/v3/projects/ea44cebc50cb4257939c99d8c328ea58 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:48.583847 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:48.924061 dv-osbrick-master-4-iscsi devstack@keystone.service[88334]: DEBUG dbcounter [-] [88334] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:27.413978 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] Authenticating user token {{(pid=88335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:27.415585 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:27.489024 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269ecfd-a2aa-4aa5-94b7-590a63905282 admin admin] Validating token access rules against request {{(pid=88335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:27.556054 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bde45-74f6-49fa-9e7e-53d8d83ffb69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd207dc4d9105430cb337641d736b318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d7298c45f049239359485d9ab62bbf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:27.556676 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bde45-74f6-49fa-9e7e-53d8d83ffb69 service placement] REQUEST_METHOD: `GET` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:27.556955 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bde45-74f6-49fa-9e7e-53d8d83ffb69 service placement] SCRIPT_NAME: `/identity` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:27.557223 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bde45-74f6-49fa-9e7e-53d8d83ffb69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:27.559011 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.fernet_utils [None req-e38bde45-74f6-49fa-9e7e-53d8d83ffb69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:27.571755 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bde45-74f6-49fa-9e7e-53d8d83ffb69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:27.573360 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bde45-74f6-49fa-9e7e-53d8d83ffb69 service placement] RBAC: Authorization granted {{(pid=88335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:27.584048 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: [pid: 88335|app: 0|req: 678/1339] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:37.579739 dv-osbrick-master-4-iscsi devstack@keystone.service[88335]: DEBUG dbcounter [-] [88335] Writing DB stats keystone:SELECT=58 {{(pid=88335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}